Nov 27 01:37:53 user devstack@n-api.service[65191]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 27 01:37:53 user devstack@n-api.service[65191]: *** Starting uWSGI 2.0.20-debian (64bit) on [Mon Nov 27 01:37:53 2023] *** Nov 27 01:37:53 user devstack@n-api.service[65191]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Nov 27 01:37:53 user devstack@n-api.service[65191]: os: Linux-5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 Nov 27 01:37:53 user devstack@n-api.service[65191]: nodename: user Nov 27 01:37:53 user devstack@n-api.service[65191]: machine: x86_64 Nov 27 01:37:53 user devstack@n-api.service[65191]: clock source: unix Nov 27 01:37:53 user devstack@n-api.service[65191]: pcre jit disabled Nov 27 01:37:53 user devstack@n-api.service[65191]: detected number of CPU cores: 12 Nov 27 01:37:53 user devstack@n-api.service[65191]: current working directory: / Nov 27 01:37:53 user devstack@n-api.service[65191]: detected binary path: /usr/bin/uwsgi-core Nov 27 01:37:53 user devstack@n-api.service[65191]: your processes number limit is 63589 Nov 27 01:37:53 user devstack@n-api.service[65191]: your memory page size is 4096 bytes Nov 27 01:37:53 user devstack@n-api.service[65191]: detected max file descriptor number: 2048 Nov 27 01:37:53 user devstack@n-api.service[65191]: lock engine: pthread robust mutexes Nov 27 01:37:53 user devstack@n-api.service[65191]: thunder lock: enabled Nov 27 01:37:53 user devstack@n-api.service[65191]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 27 01:37:53 user devstack@n-api.service[65191]: Python version: 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] Nov 27 01:37:53 user devstack@n-api.service[65191]: PEP 405 virtualenv detected: /opt/stack/data/venv Nov 27 01:37:53 user devstack@n-api.service[65191]: Set PythonHome to /opt/stack/data/venv Nov 27 01:37:53 user devstack@n-api.service[65191]: Python main interpreter initialized at 0x55d11f25db90 Nov 27 01:37:53 user devstack@n-api.service[65191]: python threads support enabled Nov 27 01:37:53 user devstack@n-api.service[65191]: your server socket listen backlog is limited to 100 connections Nov 27 01:37:53 user devstack@n-api.service[65191]: your mercy for graceful operations on workers is 80 seconds Nov 27 01:37:53 user devstack@n-api.service[65191]: mapped 537436 bytes (524 KB) for 3 cores Nov 27 01:37:53 user devstack@n-api.service[65191]: *** Operational MODE: preforking *** Nov 27 01:37:53 user devstack@n-api.service[65191]: *** uWSGI is running in multiple interpreter mode *** Nov 27 01:37:53 user devstack@n-api.service[65191]: spawned uWSGI master process (pid: 65191) Nov 27 01:37:54 user devstack@n-api.service[65191]: spawned uWSGI worker 1 (pid: 65192, cores: 1) Nov 27 01:37:54 user devstack@n-api.service[65191]: spawned uWSGI worker 2 (pid: 65193, cores: 1) Nov 27 01:37:54 user devstack@n-api.service[65191]: spawned uWSGI worker 3 (pid: 65194, cores: 1) Nov 27 01:37:54 user devstack@n-api.service[65191]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 27 01:37:57 user devstack@n-api.service[65192]: live_migration_uri is deprecated for removal in favor of two other options that Nov 27 01:37:57 user devstack@n-api.service[65192]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 27 01:37:57 user devstack@n-api.service[65192]: and ``live_migration_inbound_addr`` respectively. Nov 27 01:37:57 user devstack@n-api.service[65192]: ). Its value may be silently ignored in the future. Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 27 01:37:57 user devstack@n-api.service[65193]: live_migration_uri is deprecated for removal in favor of two other options that Nov 27 01:37:57 user devstack@n-api.service[65193]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 27 01:37:57 user devstack@n-api.service[65193]: and ``live_migration_inbound_addr`` respectively. Nov 27 01:37:57 user devstack@n-api.service[65193]: ). Its value may be silently ignored in the future. Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 27 01:37:57 user devstack@n-api.service[65194]: live_migration_uri is deprecated for removal in favor of two other options that Nov 27 01:37:57 user devstack@n-api.service[65194]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 27 01:37:57 user devstack@n-api.service[65194]: and ``live_migration_inbound_addr`` respectively. Nov 27 01:37:57 user devstack@n-api.service[65194]: ). Its value may be silently ignored in the future. Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65192) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65193) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65194) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 27 01:37:58 user devstack@n-api.service[65192]: INFO dbcounter [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Registered counter for database nova_api Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_db.sqlalchemy.engines [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writer thread running {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65193]: INFO dbcounter [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Registered counter for database nova_api Nov 27 01:37:58 user devstack@n-api.service[65194]: INFO dbcounter [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Registered counter for database nova_api Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_db.sqlalchemy.engines [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writer thread running {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_db.sqlalchemy.engines [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG nova.context [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2205dd81-f9af-4c80-b3d5-3db97aa991c0(cell1) {{(pid=65192) load_cells /opt/stack/nova/nova/context.py:464}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writer thread running {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:37:58 user devstack@n-api.service[65192]: INFO dbcounter [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Registered counter for database nova_cell0 Nov 27 01:37:58 user devstack@n-api.service[65192]: INFO dbcounter [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Registered counter for database nova_cell1 Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_db.sqlalchemy.engines [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writer thread running {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG nova.context [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2205dd81-f9af-4c80-b3d5-3db97aa991c0(cell1) {{(pid=65193) load_cells /opt/stack/nova/nova/context.py:464}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:37:58 user devstack@n-api.service[65193]: INFO dbcounter [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Registered counter for database nova_cell0 Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG nova.context [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2205dd81-f9af-4c80-b3d5-3db97aa991c0(cell1) {{(pid=65194) load_cells /opt/stack/nova/nova/context.py:464}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:37:58 user devstack@n-api.service[65193]: INFO dbcounter [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Registered counter for database nova_cell1 Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:37:58 user devstack@n-api.service[65194]: INFO dbcounter [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Registered counter for database nova_cell0 Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_db.sqlalchemy.engines [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65194]: INFO dbcounter [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Registered counter for database nova_cell1 Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writer thread running {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_db.sqlalchemy.engines [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_db.sqlalchemy.engines [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writer thread running {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_db.sqlalchemy.engines [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_db.sqlalchemy.engines [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writer thread running {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65192]: INFO dbcounter [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Registered counter for database nova_cell0 Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG oslo_db.sqlalchemy.engines [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writer thread running {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writer thread running {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65193]: INFO dbcounter [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Registered counter for database nova_cell0 Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writer thread running {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG oslo_db.sqlalchemy.engines [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writer thread running {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65194]: INFO dbcounter [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Registered counter for database nova_cell0 Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG oslo_db.sqlalchemy.engines [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65194) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 27 01:37:58 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writer thread running {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 27 01:37:58 user devstack@n-api.service[65192]: WARNING keystonemiddleware.auth_token [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 01:37:58 user devstack@n-api.service[65192]: WARNING keystonemiddleware.auth_token [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 01:37:58 user devstack@n-api.service[65194]: WARNING keystonemiddleware.auth_token [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 01:37:58 user devstack@n-api.service[65193]: WARNING keystonemiddleware.auth_token [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 01:37:58 user devstack@n-api.service[65194]: WARNING keystonemiddleware.auth_token [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 01:37:58 user devstack@n-api.service[65193]: WARNING keystonemiddleware.auth_token [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 01:37:58 user devstack@n-api.service[65192]: WARNING keystonemiddleware.auth_token [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 01:37:58 user devstack@n-api.service[65192]: WARNING keystonemiddleware.auth_token [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 01:37:58 user devstack@n-api.service[65192]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55d11f25db90 pid: 65192 (default app) Nov 27 01:37:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:37:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001488 Nov 27 01:37:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Mon Nov 27 01:37:58 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:37:58 user devstack@n-api.service[65194]: WARNING keystonemiddleware.auth_token [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 01:37:58 user devstack@n-api.service[65193]: WARNING keystonemiddleware.auth_token [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 27 01:37:58 user devstack@n-api.service[65194]: WARNING keystonemiddleware.auth_token [None req-de6e4d3c-ec45-452b-8b70-de9c59e4192b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 01:37:58 user devstack@n-api.service[65193]: WARNING keystonemiddleware.auth_token [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 27 01:37:58 user devstack@n-api.service[65194]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55d11f25db90 pid: 65194 (default app) Nov 27 01:37:58 user devstack@n-api.service[65193]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55d11f25db90 pid: 65193 (default app) Nov 27 01:40:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b67d0680-c945-481c-bbc9-f7523b8f868c None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001619 Nov 27 01:40:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:09 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-fff0a695-f235-4d55-86d8-b75e572605d6 admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-fff0a695-f235-4d55-86d8-b75e572605d6 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.394030 Nov 27 01:40:10 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1286 bytes} [Mon Nov 27 01:40:09 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002219 Nov 27 01:40:12 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:12 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:12 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:12 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:12 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:12 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:12 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-80a68bc7-8ac1-47c2-b871-5cce04289b32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-80a68bc7-8ac1-47c2-b871-5cce04289b32 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.311417 Nov 27 01:40:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:12 2023] POST /compute/v2.1/flavors => generated 405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:12 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0b0be431-4a19-4029-bd7c-910d0f8f673f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0b0be431-4a19-4029-bd7c-910d0f8f673f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041362 Nov 27 01:40:12 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1330 bytes} [Mon Nov 27 01:40:12 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:14 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:14 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001440 Nov 27 01:40:14 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:14 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-52f53c51-d016-4240-926c-f29c0087083e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:14 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-52f53c51-d016-4240-926c-f29c0087083e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064270 Nov 27 01:40:14 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:14 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-48672450-19f2-4046-a9a9-4b028038c635 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-48672450-19f2-4046-a9a9-4b028038c635 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023697 Nov 27 01:40:14 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1330 bytes} [Mon Nov 27 01:40:14 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:16 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:16 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001445 Nov 27 01:40:16 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:16 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:16 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f266b08b-b01e-41b4-87db-2b9dc8f3e0eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "swap": 0, "id": "d2", "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-f266b08b-b01e-41b4-87db-2b9dc8f3e0eb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063534 Nov 27 01:40:16 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:16 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:16 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-bf411209-32c2-4b9c-91ce-0bac18abe3ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:16 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-bf411209-32c2-4b9c-91ce-0bac18abe3ee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027459 Nov 27 01:40:16 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1330 bytes} [Mon Nov 27 01:40:16 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:18 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:18 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001303 Nov 27 01:40:18 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:18 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b6a185d8-46d2-49e8-8ff7-c32f6136f0a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b6a185d8-46d2-49e8-8ff7-c32f6136f0a4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.141039 Nov 27 01:40:18 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:18 2023] POST /compute/v2.1/flavors => generated 402 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4f546c58-2c11-464c-86f7-5d75a92f5b64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4f546c58-2c11-464c-86f7-5d75a92f5b64 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023889 Nov 27 01:40:18 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1330 bytes} [Mon Nov 27 01:40:18 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:20 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001354 Nov 27 01:40:20 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:20 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-22c502d7-00a4-4532-a77b-4415110b5a89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-22c502d7-00a4-4532-a77b-4415110b5a89 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063399 Nov 27 01:40:20 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:20 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026537 Nov 27 01:40:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1330 bytes} [Mon Nov 27 01:40:20 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:22 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3e067a25-b0c9-4b08-87cb-ebfe49239251 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001269 Nov 27 01:40:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-54f89d6e-a7d7-489d-99f5-d11e78db7531 admin admin] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-54f89d6e-a7d7-489d-99f5-d11e78db7531 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.082894 Nov 27 01:40:23 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1286 bytes} [Mon Nov 27 01:40:22 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:40:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001575 Nov 27 01:40:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:25 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:25 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:25 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:25 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:25 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:40:25 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-5a981a65-be32-49b1-b222-b886dc1ee1a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "disk": 1, "swap": 0, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-5a981a65-be32-49b1-b222-b886dc1ee1a4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.356379 Nov 27 01:40:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:25 2023] POST /compute/v2.1/flavors => generated 400 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:25 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-fa0eb045-6365-4ae9-bd5c-4d23df908e93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:25 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-fa0eb045-6365-4ae9-bd5c-4d23df908e93 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032748 Nov 27 01:40:25 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1327 bytes} [Mon Nov 27 01:40:25 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001338 Nov 27 01:40:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:27 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ca0c5887-2a7c-4976-b7d6-77be145ad547 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:27 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ca0c5887-2a7c-4976-b7d6-77be145ad547 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.074033 Nov 27 01:40:27 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:27 2023] POST /compute/v2.1/flavors => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:27 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-16cd5a0a-3d0b-475d-bbb7-185eae1f012f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-16cd5a0a-3d0b-475d-bbb7-185eae1f012f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026370 Nov 27 01:40:27 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1327 bytes} [Mon Nov 27 01:40:27 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:29 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001300 Nov 27 01:40:29 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:29 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3fb3e71d-f7a8-41c4-8c7c-3518ece6a6a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3fb3e71d-f7a8-41c4-8c7c-3518ece6a6a7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.064662 Nov 27 01:40:29 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:29 2023] POST /compute/v2.1/flavors => generated 404 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:29 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9edc7530-aa1a-4be2-9991-f97793244d78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:29 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9edc7530-aa1a-4be2-9991-f97793244d78 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033096 Nov 27 01:40:29 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1327 bytes} [Mon Nov 27 01:40:29 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001354 Nov 27 01:40:31 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-312ca1bd-e202-4c0c-8874-1a7f89e8f554 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "vcpus": 4, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-312ca1bd-e202-4c0c-8874-1a7f89e8f554 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068096 Nov 27 01:40:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:31 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-eb01db71-f007-40e8-8e4f-6a344f8e6cb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-eb01db71-f007-40e8-8e4f-6a344f8e6cb2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026586 Nov 27 01:40:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1327 bytes} [Mon Nov 27 01:40:31 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:40:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:40:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001506 Nov 27 01:40:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 925 bytes} [Mon Nov 27 01:40:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:40:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-455ff388-9131-44a8-90fd-bbbf8013a4e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-455ff388-9131-44a8-90fd-bbbf8013a4e0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.061932 Nov 27 01:40:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1277 bytes} [Mon Nov 27 01:40:33 2023] POST /compute/v2.1/flavors => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:40:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-18413284-8f62-4750-955e-59a75b60d8c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:40:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-18413284-8f62-4750-955e-59a75b60d8c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023911 Nov 27 01:40:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1327 bytes} [Mon Nov 27 01:40:33 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:41:06 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:41:06 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-85691453-b905-415a-a755-6f72fbdb6e2f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001377 Nov 27 01:41:06 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1007 bytes} [Mon Nov 27 01:41:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:41:06 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:41:06 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:41:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:41:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:41:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:41:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:41:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:41:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:41:06 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.093077 Nov 27 01:41:06 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1389 bytes} [Mon Nov 27 01:41:06 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:41:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-18413284-8f62-4750-955e-59a75b60d8c6 admin admin] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:41:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-18413284-8f62-4750-955e-59a75b60d8c6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002103 Nov 27 01:41:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1007 bytes} [Mon Nov 27 01:41:35 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:41:35 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:41:36 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-df67f0fb-929d-466a-86cc-e2612bd4fe0e admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:41:36 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-df67f0fb-929d-466a-86cc-e2612bd4fe0e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.087816 Nov 27 01:41:36 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1368 bytes} [Mon Nov 27 01:41:35 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:41:38 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:41:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-14ff3197-48a0-4722-928d-a83a9010719b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001546 Nov 27 01:41:38 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1007 bytes} [Mon Nov 27 01:41:38 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:41:38 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:41:38 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-122abd23-667e-454a-a789-0784a908641d admin admin] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:41:38 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-122abd23-667e-454a-a789-0784a908641d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 424 microversion: 2.61 time: 0.062320 Nov 27 01:41:38 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 15/41] 10.0.0.210 () {64 vars in 1311 bytes} [Mon Nov 27 01:41:38 2023] GET /compute/v2.1/flavors/1 => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:41:41 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-df67f0fb-929d-466a-86cc-e2612bd4fe0e admin admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:41:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-df67f0fb-929d-466a-86cc-e2612bd4fe0e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001342 Nov 27 01:41:41 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 14/42] 10.0.0.210 () {58 vars in 1007 bytes} [Mon Nov 27 01:41:41 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:41:41 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:41:41 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:41:41 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:41:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c9b713ad-47f5-444b-b472-47169292f587 admin admin] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:41:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c9b713ad-47f5-444b-b472-47169292f587 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/2" status: 200 len: 427 microversion: 2.61 time: 0.069817 Nov 27 01:41:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 14/43] 10.0.0.210 () {64 vars in 1311 bytes} [Mon Nov 27 01:41:41 2023] GET /compute/v2.1/flavors/2 => generated 427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:44:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:12 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b081ac01-48ce-4bd2-a7bf-611264ddb6e3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'create', calling method: .version_select at 0x7f364c3c1360>, body: {"keypair": {"name": "tempest-keypair-538026092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi+LqZU4rxdpTE+ZbzwBKfA+1x94EA+gt/8f7noWMoiulidNYrt5pVxEarcD52HNvPjCFYw1IxA4VYNEMTr19xeG3fZxmmxl6ljhDVHIj49j/IUV7NUipxKe8SSDkxuQA=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:12 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-b081ac01-48ce-4bd2-a7bf-611264ddb6e3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Getting quotas for project c0890368fe814dd5b4370275a3d0420f. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:12 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-b081ac01-48ce-4bd2-a7bf-611264ddb6e3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Getting quotas for user 2f1bb99a4d784d28abed0c4dcc03fc03 and project c0890368fe814dd5b4370275a3d0420f. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b081ac01-48ce-4bd2-a7bf-611264ddb6e3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.281845 Nov 27 01:44:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 16/44] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Nov 27 01:44:11 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 283 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 27 01:44:15 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-45c2b161-549a-48b6-98a2-a7698d9a1fa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'create', calling method: .version_select at 0x7f364c38dcf0>, body: {"keypair": {"name": "tempest-keypair-1334375291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC/l0K6xqVG8ykKB4X6FgMj9sB0OelL7PQkj1GECKLVuVzvXHUrvMWaoii10ng0QPvo/7c1E+1LvaTwcE3cCEmlqG1b0WiB3ZW+MRDzOX8hZUJDQ2tg8cB2a3Ig2Kg4/Q=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:15 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-45c2b161-549a-48b6-98a2-a7698d9a1fa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:15 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-45c2b161-549a-48b6-98a2-a7698d9a1fa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for user 4d1d312ea9224e4b9e57e5576276a485 and project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:15 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-45c2b161-549a-48b6-98a2-a7698d9a1fa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.343468 Nov 27 01:44:15 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 15/45] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:44:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1456687476", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "5787a76f-5250-487c-9397-6a4bfd68e364"}]}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:16 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] validate_networks() for [('5787a76f-5250-487c-9397-6a4bfd68e364', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Getting quotas for project 61df2ba0c7ea44b8b96ee810e90c3611. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Getting quotas for user ad1a32ce477e41df86f143a13989f498 and project 61df2ba0c7ea44b8b96ee810e90c3611. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-55ca156a-71ad-4733-8da0-b70da0ae5e00 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Action: 'create', calling method: .version_select at 0x7f364c493b50>, body: {"keypair": {"name": "tempest-keypair-1158525946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDKO1x93KHSofchbl/jJU7croaHWPHuApGXNrtyeWHBAmO2C1tAW4uE6m/5UwEfCOKmvxfKb88biWAt9rCGVMsWMauittQq8e3vVjwKj0uOCQeVjie3y3YYaSZwoLkrhA=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:17 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-55ca156a-71ad-4733-8da0-b70da0ae5e00 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Getting quotas for project 954c903a669a46feadbf6b78531c6639. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:17 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-55ca156a-71ad-4733-8da0-b70da0ae5e00 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Getting quotas for user 990555ee1c2a4bfa9858705701a49079 and project 954c903a669a46feadbf6b78531c6639. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-35d6f1cf-c62f-40a4-8565-a3b5a2b3fb9b tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.095241 Nov 27 01:44:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:44:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:44:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-55ca156a-71ad-4733-8da0-b70da0ae5e00 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049274 Nov 27 01:44:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:44:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:17 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-1fb6db6d-56a9-4572-8c5d-6d75bad744f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:17 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-1fb6db6d-56a9-4572-8c5d-6d75bad744f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:18 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1074730030", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e9b21e97-cc0e-48a9-8063-120df80128e5"}], "security_groups": [{"name": "tempest-securitygroup--431440526"}], "key_name": "tempest-keypair-538026092", "user_data": "}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:18 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-1fb6db6d-56a9-4572-8c5d-6d75bad744f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-1fb6db6d-56a9-4572-8c5d-6d75bad744f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 200 len: 1209 microversion: 2.1 time: 0.510621 Nov 27 01:44:18 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:44:17 2023] GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 1209 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:44:18 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] validate_networks() for [('e9b21e97-cc0e-48a9-8063-120df80128e5', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Getting quotas for project c0890368fe814dd5b4370275a3d0420f. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Getting quotas for user 2f1bb99a4d784d28abed0c4dcc03fc03 and project c0890368fe814dd5b4370275a3d0420f. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-8577e139-33af-49a0-a8db-d58f08f596c2 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.687921 Nov 27 01:44:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 16/49] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Nov 27 01:44:18 2023] POST /compute/v2.1/servers => generated 399 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:44:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1227635417", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-676cc513-65b7-45b6-98e2-6d676c15a565 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:19 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-676cc513-65b7-45b6-98e2-6d676c15a565 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:19 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-676cc513-65b7-45b6-98e2-6d676c15a565 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:19 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-676cc513-65b7-45b6-98e2-6d676c15a565 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:19 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-676cc513-65b7-45b6-98e2-6d676c15a565 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-676cc513-65b7-45b6-98e2-6d676c15a565 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 200 len: 1273 microversion: 2.20 time: 0.127892 Nov 27 01:44:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 17/50] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:44:19 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:44:20 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] validate_networks() for [('5626595d-0f21-42f3-b0cc-906b894ce10a', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:20 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-604723215", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "02938945-a111-40c2-94ba-4203299781f0"}], "security_groups": [{"name": "tempest-securitygroup--1650751541"}], "key_name": "tempest-keypair-1334375291", "user_data": "}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:21 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] validate_networks() for [('02938945-a111-40c2-94ba-4203299781f0', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Getting quotas for project a953169393c9425985ef738e51b22868. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Getting quotas for user 44beb0a742a24c30a7e2004988809c51 and project a953169393c9425985ef738e51b22868. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:21 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7d360bf3-ccb1-4b78-b23b-ba6052707b00 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.414795 Nov 27 01:44:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 18/51] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:44:19 2023] POST /compute/v2.1/servers => generated 381 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:44:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f5f3be5a-3318-4dd7-b10e-5f34521df830 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:21 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-f5f3be5a-3318-4dd7-b10e-5f34521df830 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:22 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-f5f3be5a-3318-4dd7-b10e-5f34521df830 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-f5f3be5a-3318-4dd7-b10e-5f34521df830 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 200 len: 1214 microversion: 2.1 time: 0.144895 Nov 27 01:44:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 18/52] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:44:21 2023] GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for user 4d1d312ea9224e4b9e57e5576276a485 and project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:22 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1940565989", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4139b389-6f39-445d-97f9-f92ff6a15110 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.679575 Nov 27 01:44:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 17/53] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:44:20 2023] POST /compute/v2.1/servers => generated 407 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:44:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-88c050d4-3fbd-4c49-98d8-31c06db8e464 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:22 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-88c050d4-3fbd-4c49-98d8-31c06db8e464 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:22 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] validate_networks() for [('5626595d-0f21-42f3-b0cc-906b894ce10a', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:22 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-88c050d4-3fbd-4c49-98d8-31c06db8e464 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-88c050d4-3fbd-4c49-98d8-31c06db8e464 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1232 microversion: 2.1 time: 0.115047 Nov 27 01:44:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 19/54] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:44:22 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1232 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Getting quotas for project a953169393c9425985ef738e51b22868. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Getting quotas for user 44beb0a742a24c30a7e2004988809c51 and project a953169393c9425985ef738e51b22868. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:24 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5be214ee-d7da-493c-bdf2-f6f76f0044ad tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.556710 Nov 27 01:44:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 19/55] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:44:22 2023] POST /compute/v2.1/servers => generated 381 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:44:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6d714990-31de-4433-a2ae-5b9b6a99f998 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:24 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6d714990-31de-4433-a2ae-5b9b6a99f998 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:24 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-166261092", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "b6e7d3cf-826e-473b-9146-f5ae88ecd497"}], "security_groups": [{"name": "tempest-securitygroup--1938318837"}], "key_name": "tempest-keypair-1158525946", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:25 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-6d714990-31de-4433-a2ae-5b9b6a99f998 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6d714990-31de-4433-a2ae-5b9b6a99f998 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6" status: 200 len: 1214 microversion: 2.1 time: 0.296942 Nov 27 01:44:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 18/56] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:44:24 2023] GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6 => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:44:25 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] validate_networks() for [('b6e7d3cf-826e-473b-9146-f5ae88ecd497', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Getting quotas for project 954c903a669a46feadbf6b78531c6639. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Getting quotas for user 990555ee1c2a4bfa9858705701a49079 and project 954c903a669a46feadbf6b78531c6639. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-9e1dd101-e848-41c4-b7d8-fca83d6deaa2 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.308014 Nov 27 01:44:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 20/57] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:44:24 2023] POST /compute/v2.1/servers => generated 404 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:44:27 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-325dd075-846f-451d-8e83-1d5edf5257b1 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:27 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-325dd075-846f-451d-8e83-1d5edf5257b1 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:27 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-325dd075-846f-451d-8e83-1d5edf5257b1 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990555ee1c2a4bfa9858705701a49079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954c903a669a46feadbf6b78531c6639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-325dd075-846f-451d-8e83-1d5edf5257b1 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 200 len: 1237 microversion: 2.1 time: 0.213773 Nov 27 01:44:27 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 20/58] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:44:27 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d199a97d-1c76-430e-b175-1cd3aba1b7e8 req-0575d386-819d-4cf6-ac36-be5647f0c371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c15d2a-ec55-45b2-8049-afe5e8bb1734", "tag": "384c3362-9874-454f-a212-414f42323c17"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d199a97d-1c76-430e-b175-1cd3aba1b7e8 req-0575d386-819d-4cf6-ac36-be5647f0c371 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d199a97d-1c76-430e-b175-1cd3aba1b7e8 req-0575d386-819d-4cf6-ac36-be5647f0c371 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d199a97d-1c76-430e-b175-1cd3aba1b7e8 req-0575d386-819d-4cf6-ac36-be5647f0c371 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d199a97d-1c76-430e-b175-1cd3aba1b7e8 req-0575d386-819d-4cf6-ac36-be5647f0c371 service nova] Creating event network-changed:384c3362-9874-454f-a212-414f42323c17 for instance e4c15d2a-ec55-45b2-8049-afe5e8bb1734 on user Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d199a97d-1c76-430e-b175-1cd3aba1b7e8 req-0575d386-819d-4cf6-ac36-be5647f0c371 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65193) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d199a97d-1c76-430e-b175-1cd3aba1b7e8 req-0575d386-819d-4cf6-ac36-be5647f0c371 service nova] Acquired lock "compute-rpcapi-router" {{(pid=65193) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:28 user devstack@n-api.service[65193]: INFO nova.compute.rpcapi [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 27 01:44:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] Releasing lock "compute-rpcapi-router" {{(pid=65193) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 27 01:44:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-991ffb28-a4d7-4ebe-b265-53c4ef45cc01 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146680 Nov 27 01:44:28 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 19/59] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-b374a43d-9298-4364-96db-309c8bdda9d3 req-9f87e4a7-6bec-4415-85f6-7365d754f99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163993f6-3b37-40ff-9372-37f866d28180", "tag": "2e93035c-a4c4-44f1-af80-c57fb2da8038"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b374a43d-9298-4364-96db-309c8bdda9d3 req-9f87e4a7-6bec-4415-85f6-7365d754f99d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b374a43d-9298-4364-96db-309c8bdda9d3 req-9f87e4a7-6bec-4415-85f6-7365d754f99d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b374a43d-9298-4364-96db-309c8bdda9d3 req-9f87e4a7-6bec-4415-85f6-7365d754f99d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-b374a43d-9298-4364-96db-309c8bdda9d3 req-9f87e4a7-6bec-4415-85f6-7365d754f99d service nova] Creating event network-changed:2e93035c-a4c4-44f1-af80-c57fb2da8038 for instance 163993f6-3b37-40ff-9372-37f866d28180 on user Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b374a43d-9298-4364-96db-309c8bdda9d3 req-9f87e4a7-6bec-4415-85f6-7365d754f99d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65194) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b374a43d-9298-4364-96db-309c8bdda9d3 req-9f87e4a7-6bec-4415-85f6-7365d754f99d service nova] Acquired lock "compute-rpcapi-router" {{(pid=65194) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:30 user devstack@n-api.service[65194]: INFO nova.compute.rpcapi [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 27 01:44:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] Releasing lock "compute-rpcapi-router" {{(pid=65194) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 27 01:44:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-da017e14-ddad-47eb-b8ed-1c8493c78f6f None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157330 Nov 27 01:44:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 21/60] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6023b645-fbe3-4187-afc3-aacbb91277f4 req-16ae5a18-e6e2-4057-a410-e28a81764467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6023b645-fbe3-4187-afc3-aacbb91277f4 req-16ae5a18-e6e2-4057-a410-e28a81764467 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6023b645-fbe3-4187-afc3-aacbb91277f4 req-16ae5a18-e6e2-4057-a410-e28a81764467 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6023b645-fbe3-4187-afc3-aacbb91277f4 req-16ae5a18-e6e2-4057-a410-e28a81764467 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:30 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6023b645-fbe3-4187-afc3-aacbb91277f4 req-16ae5a18-e6e2-4057-a410-e28a81764467 service nova] Creating event network-changed:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6023b645-fbe3-4187-afc3-aacbb91277f4 req-16ae5a18-e6e2-4057-a410-e28a81764467 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6023b645-fbe3-4187-afc3-aacbb91277f4 req-16ae5a18-e6e2-4057-a410-e28a81764467 service nova] Acquired lock "compute-rpcapi-router" {{(pid=65192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:30 user devstack@n-api.service[65192]: INFO nova.compute.rpcapi [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 27 01:44:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] Releasing lock "compute-rpcapi-router" {{(pid=65192) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 27 01:44:30 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a30f4368-e781-4aed-9395-1731227f8680 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131943 Nov 27 01:44:30 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 21/61] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:32 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-72ae81e3-c225-4f53-b0b1-69bfb2863ba7 req-2412658f-6438-471f-803f-b303a9aca652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-72ae81e3-c225-4f53-b0b1-69bfb2863ba7 req-2412658f-6438-471f-803f-b303a9aca652 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-72ae81e3-c225-4f53-b0b1-69bfb2863ba7 req-2412658f-6438-471f-803f-b303a9aca652 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-72ae81e3-c225-4f53-b0b1-69bfb2863ba7 req-2412658f-6438-471f-803f-b303a9aca652 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-72ae81e3-c225-4f53-b0b1-69bfb2863ba7 req-2412658f-6438-471f-803f-b303a9aca652 service nova] Creating event network-changed:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:44:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-72ae81e3-c225-4f53-b0b1-69bfb2863ba7 req-2412658f-6438-471f-803f-b303a9aca652 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034284 Nov 27 01:44:32 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 20/62] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-28b7a31a-7bcf-4de7-8ab0-c83dc0a7dbbf req-ca87f89a-1480-496d-86ee-b2c4cd926abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-28b7a31a-7bcf-4de7-8ab0-c83dc0a7dbbf req-ca87f89a-1480-496d-86ee-b2c4cd926abf service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-28b7a31a-7bcf-4de7-8ab0-c83dc0a7dbbf req-ca87f89a-1480-496d-86ee-b2c4cd926abf service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-28b7a31a-7bcf-4de7-8ab0-c83dc0a7dbbf req-ca87f89a-1480-496d-86ee-b2c4cd926abf service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-28b7a31a-7bcf-4de7-8ab0-c83dc0a7dbbf req-ca87f89a-1480-496d-86ee-b2c4cd926abf service nova] Creating event network-changed:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 01:44:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-28b7a31a-7bcf-4de7-8ab0-c83dc0a7dbbf req-ca87f89a-1480-496d-86ee-b2c4cd926abf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095687 Nov 27 01:44:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 22/63] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6340145d-674f-4461-861f-499315b01f27 req-49fe9541-007e-4b32-97d5-3dd6e40bca42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6340145d-674f-4461-861f-499315b01f27 req-49fe9541-007e-4b32-97d5-3dd6e40bca42 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6340145d-674f-4461-861f-499315b01f27 req-49fe9541-007e-4b32-97d5-3dd6e40bca42 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6340145d-674f-4461-861f-499315b01f27 req-49fe9541-007e-4b32-97d5-3dd6e40bca42 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6340145d-674f-4461-861f-499315b01f27 req-49fe9541-007e-4b32-97d5-3dd6e40bca42 service nova] Creating event network-changed:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:44:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6340145d-674f-4461-861f-499315b01f27 req-49fe9541-007e-4b32-97d5-3dd6e40bca42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032475 Nov 27 01:44:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:41 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=20 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:41 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=8 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-222942c7-e5a2-4fb9-a7a7-1358eefddf3f tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Action: 'create', calling method: .version_select at 0x7f364c193c70>, body: {"keypair": {"name": "tempest-keypair-917484975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+D7mi1Cy44U3lv8Kngp2JklZxyJwmT7YGwd8eqn3ad7jgT3kVGocxy9+AnDVDT1EZcZ5GWTg6JeNUCq9qA8u5adFZ3/JY1KP0w5ntvjEURuKlmHGm6hLQtMOh6UOMF/w=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:41 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-222942c7-e5a2-4fb9-a7a7-1358eefddf3f tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Getting quotas for project 6ddad7e6dfb9484aa6a5a842430d6ef9. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:41 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-222942c7-e5a2-4fb9-a7a7-1358eefddf3f tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Getting quotas for user b460cf65f2b44e42bf5e8297989b0fe9 and project 6ddad7e6dfb9484aa6a5a842430d6ef9. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-222942c7-e5a2-4fb9-a7a7-1358eefddf3f tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.499212 Nov 27 01:44:42 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 21/65] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:44:41 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=18 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=8 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-73a02328-0245-4c0a-8c99-dbe3e45cd47f req-273418bd-b5c0-4c04-b10f-134e99de4057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-plugged", "status": "completed", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73a02328-0245-4c0a-8c99-dbe3e45cd47f req-273418bd-b5c0-4c04-b10f-134e99de4057 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73a02328-0245-4c0a-8c99-dbe3e45cd47f req-273418bd-b5c0-4c04-b10f-134e99de4057 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73a02328-0245-4c0a-8c99-dbe3e45cd47f req-273418bd-b5c0-4c04-b10f-134e99de4057 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-73a02328-0245-4c0a-8c99-dbe3e45cd47f req-273418bd-b5c0-4c04-b10f-134e99de4057 service nova] Creating event network-vif-plugged:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:44:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-73a02328-0245-4c0a-8c99-dbe3e45cd47f req-273418bd-b5c0-4c04-b10f-134e99de4057 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100334 Nov 27 01:44:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 23/66] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:44 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=22 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:44 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d81b9ccc-148e-4d3b-8d60-c45815a02d4a tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Action: 'create', calling method: .version_select at 0x7f364c1f3640>, body: {"keypair": {"name": "tempest-keypair-72430363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwujjKDJJsqbF5FN1EJ0QDc0Rc8eayGN91sM28Ni6ukMYbe6su1MYH7LaWhr0dAtcdn8vFDMxwwRVLuA1gncNy7BtXwO243o/YGoagejUfPktQVtD32pUYMgK83nZnNSw=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:44 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-d81b9ccc-148e-4d3b-8d60-c45815a02d4a tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Getting quotas for project 8de2f7796550460380f122aa6ad7cfb8. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:44 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-d81b9ccc-148e-4d3b-8d60-c45815a02d4a tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Getting quotas for user 88cdd664583049a08aa80789741e373e and project 8de2f7796550460380f122aa6ad7cfb8. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d81b9ccc-148e-4d3b-8d60-c45815a02d4a tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.228646 Nov 27 01:44:44 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:44:44 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=12 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2071162402", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "5d7054e2-7c4f-40be-9c26-f95e092bda0b"}], "security_groups": [{"name": "tempest-securitygroup--1979220724"}], "key_name": "tempest-keypair-917484975", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:45 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-62f3baf5-f7c7-4d86-b686-3f7b00c88767 req-1267af3a-e059-45e7-8819-65a23488f9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-plugged", "status": "completed", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-62f3baf5-f7c7-4d86-b686-3f7b00c88767 req-1267af3a-e059-45e7-8819-65a23488f9b0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-62f3baf5-f7c7-4d86-b686-3f7b00c88767 req-1267af3a-e059-45e7-8819-65a23488f9b0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-62f3baf5-f7c7-4d86-b686-3f7b00c88767 req-1267af3a-e059-45e7-8819-65a23488f9b0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-62f3baf5-f7c7-4d86-b686-3f7b00c88767 req-1267af3a-e059-45e7-8819-65a23488f9b0 service nova] Creating event network-vif-plugged:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:44:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-62f3baf5-f7c7-4d86-b686-3f7b00c88767 req-1267af3a-e059-45e7-8819-65a23488f9b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120796 Nov 27 01:44:46 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 24/68] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:46 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] validate_networks() for [('5d7054e2-7c4f-40be-9c26-f95e092bda0b', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Getting quotas for project 6ddad7e6dfb9484aa6a5a842430d6ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Getting quotas for user b460cf65f2b44e42bf5e8297989b0fe9 and project 6ddad7e6dfb9484aa6a5a842430d6ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:47 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:47 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-922465cd-d25f-4a30-b723-913c98309942 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.801909 Nov 27 01:44:47 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 22/69] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:44:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:44:47 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=10 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:47 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e9474179-1d07-4ff5-b894-e8b0ef118a93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:47 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e9474179-1d07-4ff5-b894-e8b0ef118a93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:47 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e9474179-1d07-4ff5-b894-e8b0ef118a93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b460cf65f2b44e42bf5e8297989b0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddad7e6dfb9484aa6a5a842430d6ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e9474179-1d07-4ff5-b894-e8b0ef118a93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8" status: 200 len: 1233 microversion: 2.1 time: 0.141528 Nov 27 01:44:47 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 24/70] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:44:47 2023] GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8 => generated 1233 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:44:49 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1473878098", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "7b47a0a0-c173-4cc8-98e4-3e7ac59ec584"}], "security_groups": [{"name": "tempest-securitygroup--1264359207"}], "key_name": "tempest-keypair-72430363", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:49 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] validate_networks() for [('7b47a0a0-c173-4cc8-98e4-3e7ac59ec584', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Getting quotas for project 8de2f7796550460380f122aa6ad7cfb8. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Getting quotas for user 88cdd664583049a08aa80789741e373e and project 8de2f7796550460380f122aa6ad7cfb8. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:50 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ef9b2d07-1e5c-43f2-aa9b-5e505b8b3591 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.358739 Nov 27 01:44:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 25/71] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:44:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:44:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-2be564e7-ab72-4eab-bad7-f96f8ccc0e40 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:50 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-2be564e7-ab72-4eab-bad7-f96f8ccc0e40 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:50 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-2be564e7-ab72-4eab-bad7-f96f8ccc0e40 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cdd664583049a08aa80789741e373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de2f7796550460380f122aa6ad7cfb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-2be564e7-ab72-4eab-bad7-f96f8ccc0e40 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018" status: 200 len: 1222 microversion: 2.1 time: 0.253285 Nov 27 01:44:50 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 23/72] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:44:50 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018 => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:44:51 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-fececd41-d0d7-4e49-913a-26e41fa177aa tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Action: 'create', calling method: .version_select at 0x7f364c1f2ef0>, body: {"keypair": {"name": "tempest-keypair-2055392276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtZOflZo3QkQPCUXA/Cud4pbJRunTN0QzVLfOLFKrs5Wa9yCEZfVXuEgoifPu2Kotm/CChj7835Z47UB+PfHoOf/Ic66skMbTA9bsj485YoC6YtkNGTFbJRNgS8y9Xupg=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:51 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-fececd41-d0d7-4e49-913a-26e41fa177aa tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Getting quotas for project 228828e9e60146beb7be4fad823bfb6c. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:51 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-fececd41-d0d7-4e49-913a-26e41fa177aa tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Getting quotas for user b2e87e21090a42ca8b3c46eac21763de and project 228828e9e60146beb7be4fad823bfb6c. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:51 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-8711fcaf-a1be-4161-9aac-089a31e62e60 req-eda340d9-1f90-42a3-8779-931312f6fe3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-fececd41-d0d7-4e49-913a-26e41fa177aa tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.205064 Nov 27 01:44:52 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 25/73] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Nov 27 01:44:51 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 27 01:44:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8711fcaf-a1be-4161-9aac-089a31e62e60 req-eda340d9-1f90-42a3-8779-931312f6fe3e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8711fcaf-a1be-4161-9aac-089a31e62e60 req-eda340d9-1f90-42a3-8779-931312f6fe3e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8711fcaf-a1be-4161-9aac-089a31e62e60 req-eda340d9-1f90-42a3-8779-931312f6fe3e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-8711fcaf-a1be-4161-9aac-089a31e62e60 req-eda340d9-1f90-42a3-8779-931312f6fe3e service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:44:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-8711fcaf-a1be-4161-9aac-089a31e62e60 req-eda340d9-1f90-42a3-8779-931312f6fe3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081151 Nov 27 01:44:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 26/74] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:54 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}, {"server_uuid": "163993f6-3b37-40ff-9372-37f866d28180", "name": "network-vif-plugged", "status": "completed", "tag": "2e93035c-a4c4-44f1-af80-c57fb2da8038"}, {"server_uuid": "163993f6-3b37-40ff-9372-37f866d28180", "name": "network-vif-plugged", "status": "completed", "tag": "2e93035c-a4c4-44f1-af80-c57fb2da8038"}, {"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}, {"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:44:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Creating event network-vif-plugged:2e93035c-a4c4-44f1-af80-c57fb2da8038 for instance 163993f6-3b37-40ff-9372-37f866d28180 on user Nov 27 01:44:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Creating event network-vif-plugged:2e93035c-a4c4-44f1-af80-c57fb2da8038 for instance 163993f6-3b37-40ff-9372-37f866d28180 on user Nov 27 01:44:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:44:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:44:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-8c0311bb-24e3-44fc-b85f-80a8d2253042 req-768d34af-5932-4cc8-adb9-caee711359bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.151011 Nov 27 01:44:54 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 24/75] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:54 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-84f7695c-90dd-4ebf-b23b-4065c7e9394b req-8dee6664-3a3f-4efa-afd8-585cef8f7d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c1f4ed-6972-47f9-8578-4105ce4d7df8", "tag": "4f81c4fe-650f-481d-93ef-8b0e523d0f28"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-84f7695c-90dd-4ebf-b23b-4065c7e9394b req-8dee6664-3a3f-4efa-afd8-585cef8f7d65 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-84f7695c-90dd-4ebf-b23b-4065c7e9394b req-8dee6664-3a3f-4efa-afd8-585cef8f7d65 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-84f7695c-90dd-4ebf-b23b-4065c7e9394b req-8dee6664-3a3f-4efa-afd8-585cef8f7d65 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-84f7695c-90dd-4ebf-b23b-4065c7e9394b req-8dee6664-3a3f-4efa-afd8-585cef8f7d65 service nova] Creating event network-changed:4f81c4fe-650f-481d-93ef-8b0e523d0f28 for instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 on user Nov 27 01:44:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-84f7695c-90dd-4ebf-b23b-4065c7e9394b req-8dee6664-3a3f-4efa-afd8-585cef8f7d65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063587 Nov 27 01:44:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-593532428", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "7e925afb-a1e9-4fd9-9985-7295acfa9550"}], "security_groups": [{"name": "tempest-securitygroup--1364264869"}], "key_name": "tempest-keypair-2055392276", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:57 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] validate_networks() for [('7e925afb-a1e9-4fd9-9985-7295acfa9550', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:44:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-2d3a1d15-8570-48c5-8ad0-5cfcf7a1e8fe req-2f69375c-5846-4f69-8b7e-30ff953f8e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b8c121-240d-46f2-9e10-fdfb14753018", "tag": "f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:44:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:44:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2d3a1d15-8570-48c5-8ad0-5cfcf7a1e8fe req-2f69375c-5846-4f69-8b7e-30ff953f8e5c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2d3a1d15-8570-48c5-8ad0-5cfcf7a1e8fe req-2f69375c-5846-4f69-8b7e-30ff953f8e5c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2d3a1d15-8570-48c5-8ad0-5cfcf7a1e8fe req-2f69375c-5846-4f69-8b7e-30ff953f8e5c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-2d3a1d15-8570-48c5-8ad0-5cfcf7a1e8fe req-2f69375c-5846-4f69-8b7e-30ff953f8e5c service nova] Creating event network-changed:f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa for instance 32b8c121-240d-46f2-9e10-fdfb14753018 on user Nov 27 01:44:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-2d3a1d15-8570-48c5-8ad0-5cfcf7a1e8fe req-2f69375c-5846-4f69-8b7e-30ff953f8e5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128479 Nov 27 01:44:58 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:44:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Getting quotas for project 228828e9e60146beb7be4fad823bfb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Getting quotas for user b2e87e21090a42ca8b3c46eac21763de and project 228828e9e60146beb7be4fad823bfb6c. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:44:58 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:44:58 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ced2ca93-e31f-4ba7-9327-580f45af96da tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.717176 Nov 27 01:44:58 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 27/78] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Nov 27 01:44:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:44:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c4a70757-9003-4116-9a3c-dc91b25452be tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:44:59 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c4a70757-9003-4116-9a3c-dc91b25452be tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:44:59 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-c4a70757-9003-4116-9a3c-dc91b25452be tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:59 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-c4a70757-9003-4116-9a3c-dc91b25452be tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:59 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-c4a70757-9003-4116-9a3c-dc91b25452be tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:44:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c4a70757-9003-4116-9a3c-dc91b25452be tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab" status: 200 len: 1320 microversion: 2.49 time: 0.276705 Nov 27 01:44:59 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 27/79] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:44:58 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab => generated 1320 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:45:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=12 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-cac136ba-f1da-422d-a13c-23a6768a195d tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Action: 'create', calling method: .version_select at 0x7f364c193c70>, body: {"keypair": {"name": "tempest-keypair-1510332191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbAjDeQkcqFABMEH5UIsmR0liOO+EQXHAA/PZCpM2mUb+PUggXCzAuB2qhc/Ohyh4p/MR0kTrWVhGeaNZ9V5T2Rvyb2m5L4lm97DfoME2WVU/1Rmt3lZOmDUUCGrKsXuw=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:02 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-cac136ba-f1da-422d-a13c-23a6768a195d tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Getting quotas for project 80bedf4fb8224abbae3e881366c6ddb2. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:45:02 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-cac136ba-f1da-422d-a13c-23a6768a195d tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Getting quotas for user 20be68cb2665439facd51e94febfead1 and project 80bedf4fb8224abbae3e881366c6ddb2. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:45:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-cac136ba-f1da-422d-a13c-23a6768a195d tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.441217 Nov 27 01:45:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 26/80] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:45:01 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:03 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-e997b0ae-698d-4d5e-b036-7531e7bbe0e4 req-b32e4a4d-c64c-4994-9000-0f40b5544cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "tag": "e8111c75-793e-4e5b-9d85-f3ea893a780e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e997b0ae-698d-4d5e-b036-7531e7bbe0e4 req-b32e4a4d-c64c-4994-9000-0f40b5544cfc service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e997b0ae-698d-4d5e-b036-7531e7bbe0e4 req-b32e4a4d-c64c-4994-9000-0f40b5544cfc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e997b0ae-698d-4d5e-b036-7531e7bbe0e4 req-b32e4a4d-c64c-4994-9000-0f40b5544cfc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-e997b0ae-698d-4d5e-b036-7531e7bbe0e4 req-b32e4a4d-c64c-4994-9000-0f40b5544cfc service nova] Creating event network-changed:e8111c75-793e-4e5b-9d85-f3ea893a780e for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:45:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-e997b0ae-698d-4d5e-b036-7531e7bbe0e4 req-b32e4a4d-c64c-4994-9000-0f40b5544cfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038471 Nov 27 01:45:03 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:04 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAssistedSnapshotsTest-server-1740757821", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "45fdd9e6-90f1-4d15-9d8c-229da6ad03e8"}], "security_groups": [{"name": "tempest-securitygroup--436691109"}], "key_name": "tempest-keypair-1510332191", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:04 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:04 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] validate_networks() for [('45fdd9e6-90f1-4d15-9d8c-229da6ad03e8', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Getting quotas for project 80bedf4fb8224abbae3e881366c6ddb2. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Getting quotas for user 20be68cb2665439facd51e94febfead1 and project 80bedf4fb8224abbae3e881366c6ddb2. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:45:05 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:45:05 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4fc1b989-9681-42a6-8bba-64f6d33b9738 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.873772 Nov 27 01:45:05 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 28/82] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:45:04 2023] POST /compute/v2.1/servers => generated 403 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:45:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4993e580-b2ce-48ce-b62c-f6077dbd55be tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:05 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4993e580-b2ce-48ce-b62c-f6077dbd55be tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:05 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4993e580-b2ce-48ce-b62c-f6077dbd55be tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20be68cb2665439facd51e94febfead1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bedf4fb8224abbae3e881366c6ddb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4993e580-b2ce-48ce-b62c-f6077dbd55be tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad" status: 200 len: 1238 microversion: 2.1 time: 0.165504 Nov 27 01:45:05 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 27/83] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:05 2023] GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad => generated 1238 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:05 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-472c4322-0442-4d84-84e7-48745696dd21 req-ffea782f-4b31-4d1f-8bbb-6b365a5f5a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c1f4ed-6972-47f9-8578-4105ce4d7df8", "name": "network-vif-plugged", "status": "completed", "tag": "4f81c4fe-650f-481d-93ef-8b0e523d0f28"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-472c4322-0442-4d84-84e7-48745696dd21 req-ffea782f-4b31-4d1f-8bbb-6b365a5f5a10 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-472c4322-0442-4d84-84e7-48745696dd21 req-ffea782f-4b31-4d1f-8bbb-6b365a5f5a10 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-472c4322-0442-4d84-84e7-48745696dd21 req-ffea782f-4b31-4d1f-8bbb-6b365a5f5a10 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:05 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-472c4322-0442-4d84-84e7-48745696dd21 req-ffea782f-4b31-4d1f-8bbb-6b365a5f5a10 service nova] Creating event network-vif-plugged:4f81c4fe-650f-481d-93ef-8b0e523d0f28 for instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 on user Nov 27 01:45:05 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-472c4322-0442-4d84-84e7-48745696dd21 req-ffea782f-4b31-4d1f-8bbb-6b365a5f5a10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063400 Nov 27 01:45:06 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:06 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-925cb1bf-247d-4f89-be8b-fb7ecd4d47f7 req-efd19ff9-1308-4aba-a33c-38d126eb146f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-plugged", "status": "completed", "tag": "e8111c75-793e-4e5b-9d85-f3ea893a780e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-925cb1bf-247d-4f89-be8b-fb7ecd4d47f7 req-efd19ff9-1308-4aba-a33c-38d126eb146f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-925cb1bf-247d-4f89-be8b-fb7ecd4d47f7 req-efd19ff9-1308-4aba-a33c-38d126eb146f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-925cb1bf-247d-4f89-be8b-fb7ecd4d47f7 req-efd19ff9-1308-4aba-a33c-38d126eb146f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:06 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-925cb1bf-247d-4f89-be8b-fb7ecd4d47f7 req-efd19ff9-1308-4aba-a33c-38d126eb146f service nova] Creating event network-vif-plugged:e8111c75-793e-4e5b-9d85-f3ea893a780e for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:45:06 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-925cb1bf-247d-4f89-be8b-fb7ecd4d47f7 req-efd19ff9-1308-4aba-a33c-38d126eb146f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098399 Nov 27 01:45:06 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 29/85] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:07 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-cf2ee52a-0d59-450d-9627-8e3d374ca701 req-ea6a06fe-245d-4c12-923a-ec622f7c461b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c15d2a-ec55-45b2-8049-afe5e8bb1734", "name": "network-vif-plugged", "status": "completed", "tag": "384c3362-9874-454f-a212-414f42323c17"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-cf2ee52a-0d59-450d-9627-8e3d374ca701 req-ea6a06fe-245d-4c12-923a-ec622f7c461b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-cf2ee52a-0d59-450d-9627-8e3d374ca701 req-ea6a06fe-245d-4c12-923a-ec622f7c461b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-cf2ee52a-0d59-450d-9627-8e3d374ca701 req-ea6a06fe-245d-4c12-923a-ec622f7c461b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:07 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-cf2ee52a-0d59-450d-9627-8e3d374ca701 req-ea6a06fe-245d-4c12-923a-ec622f7c461b service nova] Creating event network-vif-plugged:384c3362-9874-454f-a212-414f42323c17 for instance e4c15d2a-ec55-45b2-8049-afe5e8bb1734 on user Nov 27 01:45:07 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-cf2ee52a-0d59-450d-9627-8e3d374ca701 req-ea6a06fe-245d-4c12-923a-ec622f7c461b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047688 Nov 27 01:45:07 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 28/86] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:08 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-49a23f7f-065a-4f89-ae35-edf06c496ac6 req-41615555-f691-4ebb-be64-8176b8740611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c1f4ed-6972-47f9-8578-4105ce4d7df8", "name": "network-vif-plugged", "status": "completed", "tag": "4f81c4fe-650f-481d-93ef-8b0e523d0f28"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-49a23f7f-065a-4f89-ae35-edf06c496ac6 req-41615555-f691-4ebb-be64-8176b8740611 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-49a23f7f-065a-4f89-ae35-edf06c496ac6 req-41615555-f691-4ebb-be64-8176b8740611 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-49a23f7f-065a-4f89-ae35-edf06c496ac6 req-41615555-f691-4ebb-be64-8176b8740611 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-49a23f7f-065a-4f89-ae35-edf06c496ac6 req-41615555-f691-4ebb-be64-8176b8740611 service nova] Creating event network-vif-plugged:4f81c4fe-650f-481d-93ef-8b0e523d0f28 for instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 on user Nov 27 01:45:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-49a23f7f-065a-4f89-ae35-edf06c496ac6 req-41615555-f691-4ebb-be64-8176b8740611 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114567 Nov 27 01:45:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 30/87] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:08 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:08 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:08 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d0416281-b6a0-402c-96f8-7f9b185d4570 req-a94b119e-150b-47f6-9091-52bb37b495f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-plugged", "status": "completed", "tag": "e8111c75-793e-4e5b-9d85-f3ea893a780e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d0416281-b6a0-402c-96f8-7f9b185d4570 req-a94b119e-150b-47f6-9091-52bb37b495f2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d0416281-b6a0-402c-96f8-7f9b185d4570 req-a94b119e-150b-47f6-9091-52bb37b495f2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d0416281-b6a0-402c-96f8-7f9b185d4570 req-a94b119e-150b-47f6-9091-52bb37b495f2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d0416281-b6a0-402c-96f8-7f9b185d4570 req-a94b119e-150b-47f6-9091-52bb37b495f2 service nova] Creating event network-vif-plugged:e8111c75-793e-4e5b-9d85-f3ea893a780e for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:45:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-d0416281-b6a0-402c-96f8-7f9b185d4570 req-a94b119e-150b-47f6-9091-52bb37b495f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047910 Nov 27 01:45:08 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 29/88] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:09 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-db7a4281-e0b6-43be-a398-889c85c6fb82 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 200 len: 1492 microversion: 2.1 time: 0.723962 Nov 27 01:45:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 30/89] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:08 2023] GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 1492 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=12 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-be0d85f6-23c0-4123-afe9-db3101242f2d req-5d114f17-5ff6-4249-9203-c0ef6e495df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c15d2a-ec55-45b2-8049-afe5e8bb1734", "name": "network-vif-plugged", "status": "completed", "tag": "384c3362-9874-454f-a212-414f42323c17"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-be0d85f6-23c0-4123-afe9-db3101242f2d req-5d114f17-5ff6-4249-9203-c0ef6e495df0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-be0d85f6-23c0-4123-afe9-db3101242f2d req-5d114f17-5ff6-4249-9203-c0ef6e495df0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-be0d85f6-23c0-4123-afe9-db3101242f2d req-5d114f17-5ff6-4249-9203-c0ef6e495df0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-be0d85f6-23c0-4123-afe9-db3101242f2d req-5d114f17-5ff6-4249-9203-c0ef6e495df0 service nova] Creating event network-vif-plugged:384c3362-9874-454f-a212-414f42323c17 for instance e4c15d2a-ec55-45b2-8049-afe5e8bb1734 on user Nov 27 01:45:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-be0d85f6-23c0-4123-afe9-db3101242f2d req-5d114f17-5ff6-4249-9203-c0ef6e495df0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058636 Nov 27 01:45:09 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 31/90] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:09 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:10 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-93ef8ad5-0a6e-4fd1-97e9-0ce0cf388139 req-80c3766a-7911-40ca-92a6-2a242d6eba1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3ea204-3973-4a37-924b-b09cd19b7fad", "tag": "5c0af32c-d4a0-475d-8ed8-89c716bc2925"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-93ef8ad5-0a6e-4fd1-97e9-0ce0cf388139 req-80c3766a-7911-40ca-92a6-2a242d6eba1d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-93ef8ad5-0a6e-4fd1-97e9-0ce0cf388139 req-80c3766a-7911-40ca-92a6-2a242d6eba1d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-93ef8ad5-0a6e-4fd1-97e9-0ce0cf388139 req-80c3766a-7911-40ca-92a6-2a242d6eba1d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:10 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-93ef8ad5-0a6e-4fd1-97e9-0ce0cf388139 req-80c3766a-7911-40ca-92a6-2a242d6eba1d service nova] Creating event network-changed:5c0af32c-d4a0-475d-8ed8-89c716bc2925 for instance eb3ea204-3973-4a37-924b-b09cd19b7fad on user Nov 27 01:45:10 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-93ef8ad5-0a6e-4fd1-97e9-0ce0cf388139 req-80c3766a-7911-40ca-92a6-2a242d6eba1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060915 Nov 27 01:45:10 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:10 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:10 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:10 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9bf3045d-b1b8-4f92-b9af-3d3d4b7655bd tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 200 len: 1585 microversion: 2.20 time: 0.820763 Nov 27 01:45:10 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 30/92] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:45:09 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 1585 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:45:12 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-03a85878-d678-41cc-b3cd-fdee4466a7fa req-d158372a-0dcc-4dd8-8a47-19de1bebae70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3ea204-3973-4a37-924b-b09cd19b7fad", "name": "network-vif-plugged", "status": "completed", "tag": "5c0af32c-d4a0-475d-8ed8-89c716bc2925"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-03a85878-d678-41cc-b3cd-fdee4466a7fa req-d158372a-0dcc-4dd8-8a47-19de1bebae70 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-03a85878-d678-41cc-b3cd-fdee4466a7fa req-d158372a-0dcc-4dd8-8a47-19de1bebae70 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-03a85878-d678-41cc-b3cd-fdee4466a7fa req-d158372a-0dcc-4dd8-8a47-19de1bebae70 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-03a85878-d678-41cc-b3cd-fdee4466a7fa req-d158372a-0dcc-4dd8-8a47-19de1bebae70 service nova] Creating event network-vif-plugged:5c0af32c-d4a0-475d-8ed8-89c716bc2925 for instance eb3ea204-3973-4a37-924b-b09cd19b7fad on user Nov 27 01:45:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-03a85878-d678-41cc-b3cd-fdee4466a7fa req-d158372a-0dcc-4dd8-8a47-19de1bebae70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093838 Nov 27 01:45:12 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=110,nova_api:INSERT=13 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:12 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-def4d25b-9ba8-4d7d-80fe-3b1d90f72baf tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1542 microversion: 2.1 time: 0.337394 Nov 27 01:45:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 32/94] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:12 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1542 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-c8e64fa1-4dca-4eb7-a0b2-f6be0b8c9ab0 req-f082c37d-a153-4192-9184-a55d62d2b726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c8e64fa1-4dca-4eb7-a0b2-f6be0b8c9ab0 req-f082c37d-a153-4192-9184-a55d62d2b726 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c8e64fa1-4dca-4eb7-a0b2-f6be0b8c9ab0 req-f082c37d-a153-4192-9184-a55d62d2b726 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c8e64fa1-4dca-4eb7-a0b2-f6be0b8c9ab0 req-f082c37d-a153-4192-9184-a55d62d2b726 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-c8e64fa1-4dca-4eb7-a0b2-f6be0b8c9ab0 req-f082c37d-a153-4192-9184-a55d62d2b726 service nova] Creating event network-vif-plugged:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 01:45:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-c8e64fa1-4dca-4eb7-a0b2-f6be0b8c9ab0 req-f082c37d-a153-4192-9184-a55d62d2b726 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030631 Nov 27 01:45:12 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-234f7fe8-4e4b-4584-a18a-28ae98958b7d req-92d187ad-5e3e-4d69-abcf-6bee07d9c1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3ea204-3973-4a37-924b-b09cd19b7fad", "name": "network-vif-plugged", "status": "completed", "tag": "5c0af32c-d4a0-475d-8ed8-89c716bc2925"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-234f7fe8-4e4b-4584-a18a-28ae98958b7d req-92d187ad-5e3e-4d69-abcf-6bee07d9c1b6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-234f7fe8-4e4b-4584-a18a-28ae98958b7d req-92d187ad-5e3e-4d69-abcf-6bee07d9c1b6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-234f7fe8-4e4b-4584-a18a-28ae98958b7d req-92d187ad-5e3e-4d69-abcf-6bee07d9c1b6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-234f7fe8-4e4b-4584-a18a-28ae98958b7d req-92d187ad-5e3e-4d69-abcf-6bee07d9c1b6 service nova] Creating event network-vif-plugged:5c0af32c-d4a0-475d-8ed8-89c716bc2925 for instance eb3ea204-3973-4a37-924b-b09cd19b7fad on user Nov 27 01:45:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-234f7fe8-4e4b-4584-a18a-28ae98958b7d req-92d187ad-5e3e-4d69-abcf-6bee07d9c1b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045390 Nov 27 01:45:14 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:45:14 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-835a26b5-0e00-48b0-ae7e-2e74985bd4d3 req-ecb83417-95ab-4b32-b3ad-33e332803ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}, {"server_uuid": "32b8c121-240d-46f2-9e10-fdfb14753018", "name": "network-vif-plugged", "status": "completed", "tag": "f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa"}, {"server_uuid": "32b8c121-240d-46f2-9e10-fdfb14753018", "name": "network-vif-plugged", "status": "completed", "tag": "f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-835a26b5-0e00-48b0-ae7e-2e74985bd4d3 req-ecb83417-95ab-4b32-b3ad-33e332803ae2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-835a26b5-0e00-48b0-ae7e-2e74985bd4d3 req-ecb83417-95ab-4b32-b3ad-33e332803ae2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-835a26b5-0e00-48b0-ae7e-2e74985bd4d3 req-ecb83417-95ab-4b32-b3ad-33e332803ae2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-835a26b5-0e00-48b0-ae7e-2e74985bd4d3 req-ecb83417-95ab-4b32-b3ad-33e332803ae2 service nova] Creating event network-vif-plugged:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 01:45:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-835a26b5-0e00-48b0-ae7e-2e74985bd4d3 req-ecb83417-95ab-4b32-b3ad-33e332803ae2 service nova] Creating event network-vif-plugged:f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa for instance 32b8c121-240d-46f2-9e10-fdfb14753018 on user Nov 27 01:45:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-835a26b5-0e00-48b0-ae7e-2e74985bd4d3 req-ecb83417-95ab-4b32-b3ad-33e332803ae2 service nova] Creating event network-vif-plugged:f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa for instance 32b8c121-240d-46f2-9e10-fdfb14753018 on user Nov 27 01:45:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-835a26b5-0e00-48b0-ae7e-2e74985bd4d3 req-ecb83417-95ab-4b32-b3ad-33e332803ae2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.120885 Nov 27 01:45:15 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 33/97] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:15 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-877c8ce1-848d-4cd1-bf62-bdaa55b40f44 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6" status: 200 len: 1501 microversion: 2.1 time: 0.256180 Nov 27 01:45:15 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 32/98] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:15 2023] GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6 => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:17 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:17 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:18 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990555ee1c2a4bfa9858705701a49079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954c903a669a46feadbf6b78531c6639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-63a53fd4-eb70-47ee-a230-8e42891f0bf9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 200 len: 1551 microversion: 2.1 time: 0.595905 Nov 27 01:45:18 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 34/99] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:17 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 1551 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:19 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:19 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=18 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d1d25c09-346f-4c41-9c85-4f5b85d1e2c1 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Action: 'create', calling method: .version_select at 0x7f364b83e830>, body: {"keypair": {"name": "tempest-keypair-1496479439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6srMYn8bInONjYDxYZW+zDipAjr+2X+1i2Z7dufTL+1siN/D8mZixOLZUgInrHHzH+VvNRJQe7v53mZlvy2KH1SkGMt1AaQYiKbEr4d+IYyKWgYzsDRbIOXSg4kSWGgQ=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:19 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-d1d25c09-346f-4c41-9c85-4f5b85d1e2c1 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Getting quotas for project 879d7e83642942bcb4262bc9332cf6df. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:45:19 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-d1d25c09-346f-4c41-9c85-4f5b85d1e2c1 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Getting quotas for user 499d3567379a458185cf3f72f4633c40 and project 879d7e83642942bcb4262bc9332cf6df. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:45:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d1d25c09-346f-4c41-9c85-4f5b85d1e2c1 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.084852 Nov 27 01:45:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 34/100] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Nov 27 01:45:19 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 27 01:45:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1866983269", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "fdb8f2ee-0883-4caa-8d15-5e3852d458f5"}, {"port": "6575ac64-ee65-426c-9f6e-d12ec742e930", "tag": "port-1"}, {"port": "652be731-49dc-4bbf-b2c4-96ac294b1e2f", "tag": "port-2"}, {"uuid": "4f0cd2cb-6739-4609-9c4b-fbdd216eace8", "tag": "net-1"}, {"uuid": "4f0cd2cb-6739-4609-9c4b-fbdd216eace8"}, {"uuid": "a71a7497-ab67-43a0-84b0-1c6cf66da9cd", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a71a7497-ab67-43a0-84b0-1c6cf66da9cd", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e8b63f0e-4d15-4ab6-a5e2-1cd48a43641f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "00165e49-4963-4eab-8d99-f6201a68d203", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "63e8e9fa-74af-41f8-9501-d1f4cef8fffb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--25502903"}], "key_name": "tempest-keypair-1496479439", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:21 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:21 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=111,nova_api:INSERT=14 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:21 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] validate_networks() for [('fdb8f2ee-0883-4caa-8d15-5e3852d458f5', None, None, None, None, None), (None, None, '6575ac64-ee65-426c-9f6e-d12ec742e930', None, None, None), (None, None, '652be731-49dc-4bbf-b2c4-96ac294b1e2f', None, None, None), ('4f0cd2cb-6739-4609-9c4b-fbdd216eace8', None, None, None, None, None), ('4f0cd2cb-6739-4609-9c4b-fbdd216eace8', None, None, None, None, None), ('a71a7497-ab67-43a0-84b0-1c6cf66da9cd', '10.2.2.100', None, None, None, None), ('a71a7497-ab67-43a0-84b0-1c6cf66da9cd', '10.2.2.200', None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Getting quotas for project 879d7e83642942bcb4262bc9332cf6df. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Getting quotas for user 499d3567379a458185cf3f72f4633c40 and project 879d7e83642942bcb4262bc9332cf6df. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:45:24 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e8b63f0e-4d15-4ab6-a5e2-1cd48a43641f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='00165e49-4963-4eab-8d99-f6201a68d203',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63e8e9fa-74af-41f8-9501-d1f4cef8fffb',volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:45:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6300cc1b-d3bc-4919-b020-89d3f8b04108 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.32 time: 3.947975 Nov 27 01:45:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 33/101] 10.0.0.210 () {66 vars in 1266 bytes} [Mon Nov 27 01:45:21 2023] POST /compute/v2.1/servers => generated 402 bytes in 3950 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:45:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4cc7ddd7-c2de-4f50-81c9-1adfc9e50563 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4cc7ddd7-c2de-4f50-81c9-1adfc9e50563 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:25 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4cc7ddd7-c2de-4f50-81c9-1adfc9e50563 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:25 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4cc7ddd7-c2de-4f50-81c9-1adfc9e50563 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:25 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4cc7ddd7-c2de-4f50-81c9-1adfc9e50563 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4cc7ddd7-c2de-4f50-81c9-1adfc9e50563 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c" status: 200 len: 1278 microversion: 2.32 time: 0.086673 Nov 27 01:45:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 35/102] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:45:25 2023] GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 01:45:25 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=20 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:25 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e2eda279-c4ae-440d-a360-d42f552bfafa tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Action: 'create', calling method: .version_select at 0x7f364b83e950>, body: {"keypair": {"name": "tempest-keypair-390478396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdmsv3XbJF1nH9h+eYAuJFClIUix+S9TrlzPncxXQFMHhH/wr3ljDTy8WLJX0t3z5WuCu9OifndR9yA7y+lcwGrClCH4cbGUrxiFo8CD8/vgowh2+MxIiqkhHfWq4zNZg=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:25 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-e2eda279-c4ae-440d-a360-d42f552bfafa tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Getting quotas for project bb5047346f5a41599b86602ad3538e53. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:45:25 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-e2eda279-c4ae-440d-a360-d42f552bfafa tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Getting quotas for user 1d52b9eb758a480aaf7c1f6f4b985177 and project bb5047346f5a41599b86602ad3538e53. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:45:25 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e2eda279-c4ae-440d-a360-d42f552bfafa tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.046003 Nov 27 01:45:25 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 35/103] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Nov 27 01:45:25 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 27 01:45:27 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-109385874", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "66e8e05a-4883-4521-a419-08ad8f434f2b"}, {"port": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2", "tag": "port-1"}, {"port": "1ec02ad7-a7a8-4602-942a-b66c57a56b0e", "tag": "port-2"}, {"uuid": "39af2ccd-9b3c-4cde-b59a-bd0faca02e0e", "tag": "net-1"}, {"uuid": "39af2ccd-9b3c-4cde-b59a-bd0faca02e0e"}, {"uuid": "49e8dc1a-8ba1-4f86-b9c5-c25600fcde30", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "49e8dc1a-8ba1-4f86-b9c5-c25600fcde30", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4568fa5e-e862-4d52-9066-ca627811f0ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e2ae9e12-7d71-40f0-a2f5-cd38b8638b87", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b08249a3-8999-416a-b0b0-66a363668822", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--851118653"}], "key_name": "tempest-keypair-390478396", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:27 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] validate_networks() for [('66e8e05a-4883-4521-a419-08ad8f434f2b', None, None, None, None, None), (None, None, 'd1f14c4b-b1e9-48b0-aba9-e384b3d751a2', None, None, None), (None, None, '1ec02ad7-a7a8-4602-942a-b66c57a56b0e', None, None, None), ('39af2ccd-9b3c-4cde-b59a-bd0faca02e0e', None, None, None, None, None), ('39af2ccd-9b3c-4cde-b59a-bd0faca02e0e', None, None, None, None, None), ('49e8dc1a-8ba1-4f86-b9c5-c25600fcde30', '10.2.2.100', None, None, None, None), ('49e8dc1a-8ba1-4f86-b9c5-c25600fcde30', '10.2.2.200', None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Getting quotas for project bb5047346f5a41599b86602ad3538e53. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Getting quotas for user 1d52b9eb758a480aaf7c1f6f4b985177 and project bb5047346f5a41599b86602ad3538e53. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:45:31 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4568fa5e-e862-4d52-9066-ca627811f0ec',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e2ae9e12-7d71-40f0-a2f5-cd38b8638b87',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b08249a3-8999-416a-b0b0-66a363668822',volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:45:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c2ac3a26-35e6-4bd7-9504-360c44709146 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 4.285255 Nov 27 01:45:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 34/104] 10.0.0.210 () {66 vars in 1266 bytes} [Mon Nov 27 01:45:27 2023] POST /compute/v2.1/servers => generated 403 bytes in 4287 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:45:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-bdc8a3cf-9073-4f2b-9192-98fc0f74e9dc tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:31 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-bdc8a3cf-9073-4f2b-9192-98fc0f74e9dc tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:31 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=28 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:31 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-bdc8a3cf-9073-4f2b-9192-98fc0f74e9dc tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:31 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-bdc8a3cf-9073-4f2b-9192-98fc0f74e9dc tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:31 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-bdc8a3cf-9073-4f2b-9192-98fc0f74e9dc tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-bdc8a3cf-9073-4f2b-9192-98fc0f74e9dc tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92" status: 200 len: 1276 microversion: 2.42 time: 0.093232 Nov 27 01:45:31 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 36/105] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:45:31 2023] GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:45:32 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-105afe0f-35ef-4598-b0c7-0c3308b763b2 req-88fe510a-239c-4f37-979f-82fa1d31c5df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "tag": "03f1300a-8159-45e6-9e84-0987d6d4b3a7"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-105afe0f-35ef-4598-b0c7-0c3308b763b2 req-88fe510a-239c-4f37-979f-82fa1d31c5df service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-105afe0f-35ef-4598-b0c7-0c3308b763b2 req-88fe510a-239c-4f37-979f-82fa1d31c5df service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-105afe0f-35ef-4598-b0c7-0c3308b763b2 req-88fe510a-239c-4f37-979f-82fa1d31c5df service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-105afe0f-35ef-4598-b0c7-0c3308b763b2 req-88fe510a-239c-4f37-979f-82fa1d31c5df service nova] Creating event network-changed:03f1300a-8159-45e6-9e84-0987d6d4b3a7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-105afe0f-35ef-4598-b0c7-0c3308b763b2 req-88fe510a-239c-4f37-979f-82fa1d31c5df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035704 Nov 27 01:45:32 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 36/106] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:45:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-55f790a8-111d-45df-ad17-ed5f90c7526a req-3896260a-922e-47d6-91c9-3f91d030abed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "tag": "6575ac64-ee65-426c-9f6e-d12ec742e930"}, {"name": "network-changed", "server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "tag": "652be731-49dc-4bbf-b2c4-96ac294b1e2f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-55f790a8-111d-45df-ad17-ed5f90c7526a req-3896260a-922e-47d6-91c9-3f91d030abed service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-55f790a8-111d-45df-ad17-ed5f90c7526a req-3896260a-922e-47d6-91c9-3f91d030abed service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-55f790a8-111d-45df-ad17-ed5f90c7526a req-3896260a-922e-47d6-91c9-3f91d030abed service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-55f790a8-111d-45df-ad17-ed5f90c7526a req-3896260a-922e-47d6-91c9-3f91d030abed service nova] Creating event network-changed:6575ac64-ee65-426c-9f6e-d12ec742e930 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-55f790a8-111d-45df-ad17-ed5f90c7526a req-3896260a-922e-47d6-91c9-3f91d030abed service nova] Creating event network-changed:652be731-49dc-4bbf-b2c4-96ac294b1e2f for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-55f790a8-111d-45df-ad17-ed5f90c7526a req-3896260a-922e-47d6-91c9-3f91d030abed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038327 Nov 27 01:45:34 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 35/107] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:34 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-101286197", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] validate_networks() for None {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Getting quotas for project 94532ed6cedd4a158f8f3a9099c6c76c. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Getting quotas for user 5a974479967c4720817ccac8161d3fa0 and project 94532ed6cedd4a158f8f3a9099c6c76c. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:45:35 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] [instance: 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:45:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a875ba6c-c900-444e-b1b1-80d68f7c16e4 tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.411619 Nov 27 01:45:35 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 37/108] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:45:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:45:35 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-60c71a36-3f03-40a4-af28-3c49b3065f0f tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:35 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-60c71a36-3f03-40a4-af28-3c49b3065f0f tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] [instance: 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:35 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-60c71a36-3f03-40a4-af28-3c49b3065f0f tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a974479967c4720817ccac8161d3fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94532ed6cedd4a158f8f3a9099c6c76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-60c71a36-3f03-40a4-af28-3c49b3065f0f tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68" status: 200 len: 1206 microversion: 2.1 time: 0.064509 Nov 27 01:45:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:35 2023] GET /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 => generated 1206 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:36 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-e08d24ee-6c47-4775-8ad2-5be9236c3441 req-c73d2bf9-14a0-49ea-8d5d-e97d7472f2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "tag": "c700bd0a-6895-435d-a4c8-baba0bec47f7"}, {"name": "network-changed", "server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "tag": "56b01b62-5838-42d0-b238-f09531c57a0c"}, {"name": "network-changed", "server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "tag": "5c48a087-d5b6-49ca-8842-9f9901638031"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e08d24ee-6c47-4775-8ad2-5be9236c3441 req-c73d2bf9-14a0-49ea-8d5d-e97d7472f2c0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e08d24ee-6c47-4775-8ad2-5be9236c3441 req-c73d2bf9-14a0-49ea-8d5d-e97d7472f2c0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e08d24ee-6c47-4775-8ad2-5be9236c3441 req-c73d2bf9-14a0-49ea-8d5d-e97d7472f2c0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e08d24ee-6c47-4775-8ad2-5be9236c3441 req-c73d2bf9-14a0-49ea-8d5d-e97d7472f2c0 service nova] Creating event network-changed:c700bd0a-6895-435d-a4c8-baba0bec47f7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e08d24ee-6c47-4775-8ad2-5be9236c3441 req-c73d2bf9-14a0-49ea-8d5d-e97d7472f2c0 service nova] Creating event network-changed:56b01b62-5838-42d0-b238-f09531c57a0c for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e08d24ee-6c47-4775-8ad2-5be9236c3441 req-c73d2bf9-14a0-49ea-8d5d-e97d7472f2c0 service nova] Creating event network-changed:5c48a087-d5b6-49ca-8842-9f9901638031 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-e08d24ee-6c47-4775-8ad2-5be9236c3441 req-c73d2bf9-14a0-49ea-8d5d-e97d7472f2c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.040162 Nov 27 01:45:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:37 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:37 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:38 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b460cf65f2b44e42bf5e8297989b0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddad7e6dfb9484aa6a5a842430d6ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:38 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6531179b-42ff-4f07-ad5f-10499d894387 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8" status: 200 len: 1543 microversion: 2.1 time: 0.208727 Nov 27 01:45:38 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 38/111] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:37 2023] GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8 => generated 1543 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:38 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-d6692ba4-7689-46a6-a5fd-27abe274b347 req-3ed9c0c1-6cae-4844-92b6-0a71167ba845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "tag": "eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d6692ba4-7689-46a6-a5fd-27abe274b347 req-3ed9c0c1-6cae-4844-92b6-0a71167ba845 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d6692ba4-7689-46a6-a5fd-27abe274b347 req-3ed9c0c1-6cae-4844-92b6-0a71167ba845 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d6692ba4-7689-46a6-a5fd-27abe274b347 req-3ed9c0c1-6cae-4844-92b6-0a71167ba845 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:38 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-d6692ba4-7689-46a6-a5fd-27abe274b347 req-3ed9c0c1-6cae-4844-92b6-0a71167ba845 service nova] Creating event network-changed:eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:38 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-d6692ba4-7689-46a6-a5fd-27abe274b347 req-3ed9c0c1-6cae-4844-92b6-0a71167ba845 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039749 Nov 27 01:45:38 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-a87084ee-4b76-47fa-a315-ca0c51232f73 req-da44c0db-4545-4644-9ea0-5ff7d49bd13e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15dd9d3a-8c28-45c7-9fa2-bfee97b58e68", "tag": "8201dd6b-3457-4b64-bee5-ac914d578700"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a87084ee-4b76-47fa-a315-ca0c51232f73 req-da44c0db-4545-4644-9ea0-5ff7d49bd13e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a87084ee-4b76-47fa-a315-ca0c51232f73 req-da44c0db-4545-4644-9ea0-5ff7d49bd13e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a87084ee-4b76-47fa-a315-ca0c51232f73 req-da44c0db-4545-4644-9ea0-5ff7d49bd13e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-a87084ee-4b76-47fa-a315-ca0c51232f73 req-da44c0db-4545-4644-9ea0-5ff7d49bd13e service nova] Creating event network-changed:8201dd6b-3457-4b64-bee5-ac914d578700 for instance 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 on user Nov 27 01:45:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-a87084ee-4b76-47fa-a315-ca0c51232f73 req-da44c0db-4545-4644-9ea0-5ff7d49bd13e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030659 Nov 27 01:45:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 37/113] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:40 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cdd664583049a08aa80789741e373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de2f7796550460380f122aa6ad7cfb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ad5deaf1-c0cc-4b71-bfb8-db4e2b3bb596 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018" status: 200 len: 1523 microversion: 2.1 time: 0.235761 Nov 27 01:45:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 39/114] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:40 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:42 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-4e91858f-2f88-4026-ac7f-d103b1c34155 req-9be725b7-a77f-4188-bd13-a4284571a45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "tag": "25b7419f-d628-4926-b706-f066c254e9b1"}, {"name": "network-changed", "server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e91858f-2f88-4026-ac7f-d103b1c34155 req-9be725b7-a77f-4188-bd13-a4284571a45a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e91858f-2f88-4026-ac7f-d103b1c34155 req-9be725b7-a77f-4188-bd13-a4284571a45a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e91858f-2f88-4026-ac7f-d103b1c34155 req-9be725b7-a77f-4188-bd13-a4284571a45a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4e91858f-2f88-4026-ac7f-d103b1c34155 req-9be725b7-a77f-4188-bd13-a4284571a45a service nova] Creating event network-changed:25b7419f-d628-4926-b706-f066c254e9b1 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:45:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4e91858f-2f88-4026-ac7f-d103b1c34155 req-9be725b7-a77f-4188-bd13-a4284571a45a service nova] Creating event network-changed:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:45:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-4e91858f-2f88-4026-ac7f-d103b1c34155 req-9be725b7-a77f-4188-bd13-a4284571a45a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033345 Nov 27 01:45:42 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:42 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:44 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:44 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=12 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:44 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-7d4b0208-cabd-45ff-8df4-e7824f51b32c req-efb0d76a-debf-447a-83a8-b64494668dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15dd9d3a-8c28-45c7-9fa2-bfee97b58e68", "name": "network-vif-plugged", "status": "completed", "tag": "8201dd6b-3457-4b64-bee5-ac914d578700"}, {"server_uuid": "15dd9d3a-8c28-45c7-9fa2-bfee97b58e68", "name": "network-vif-plugged", "status": "completed", "tag": "8201dd6b-3457-4b64-bee5-ac914d578700"}, {"name": "network-changed", "server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "tag": "1ec02ad7-a7a8-4602-942a-b66c57a56b0e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7d4b0208-cabd-45ff-8df4-e7824f51b32c req-efb0d76a-debf-447a-83a8-b64494668dc8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7d4b0208-cabd-45ff-8df4-e7824f51b32c req-efb0d76a-debf-447a-83a8-b64494668dc8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7d4b0208-cabd-45ff-8df4-e7824f51b32c req-efb0d76a-debf-447a-83a8-b64494668dc8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7d4b0208-cabd-45ff-8df4-e7824f51b32c req-efb0d76a-debf-447a-83a8-b64494668dc8 service nova] Creating event network-vif-plugged:8201dd6b-3457-4b64-bee5-ac914d578700 for instance 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 on user Nov 27 01:45:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7d4b0208-cabd-45ff-8df4-e7824f51b32c req-efb0d76a-debf-447a-83a8-b64494668dc8 service nova] Creating event network-vif-plugged:8201dd6b-3457-4b64-bee5-ac914d578700 for instance 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 on user Nov 27 01:45:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7d4b0208-cabd-45ff-8df4-e7824f51b32c req-efb0d76a-debf-447a-83a8-b64494668dc8 service nova] Creating event network-changed:1ec02ad7-a7a8-4602-942a-b66c57a56b0e for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:45:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-7d4b0208-cabd-45ff-8df4-e7824f51b32c req-efb0d76a-debf-447a-83a8-b64494668dc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.060051 Nov 27 01:45:44 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 38/116] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:44 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:46 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-25c97419-5b69-449c-9872-389c388fc249 req-cd12b37f-635e-4414-8c9e-daa1952732ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "tag": "0d99dd83-0e0d-4052-a410-d50b9102db65"}, {"name": "network-changed", "server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "tag": "b594e43e-af6b-49cd-92e0-12147106071d"}, {"name": "network-changed", "server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "tag": "58a0b7b7-ca5d-4889-9462-f3181c37db01"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:46 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:46 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=10 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:46 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-25c97419-5b69-449c-9872-389c388fc249 req-cd12b37f-635e-4414-8c9e-daa1952732ff service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-25c97419-5b69-449c-9872-389c388fc249 req-cd12b37f-635e-4414-8c9e-daa1952732ff service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-25c97419-5b69-449c-9872-389c388fc249 req-cd12b37f-635e-4414-8c9e-daa1952732ff service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-25c97419-5b69-449c-9872-389c388fc249 req-cd12b37f-635e-4414-8c9e-daa1952732ff service nova] Creating event network-changed:0d99dd83-0e0d-4052-a410-d50b9102db65 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:45:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-25c97419-5b69-449c-9872-389c388fc249 req-cd12b37f-635e-4414-8c9e-daa1952732ff service nova] Creating event network-changed:b594e43e-af6b-49cd-92e0-12147106071d for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:45:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-25c97419-5b69-449c-9872-389c388fc249 req-cd12b37f-635e-4414-8c9e-daa1952732ff service nova] Creating event network-changed:58a0b7b7-ca5d-4889-9462-f3181c37db01 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:45:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-25c97419-5b69-449c-9872-389c388fc249 req-cd12b37f-635e-4414-8c9e-daa1952732ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.041541 Nov 27 01:45:46 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 40/117] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:45:48 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6d611ac5-6574-4d69-b818-47832409eb42 req-ddf5ec55-9f33-4e88-b2d6-17ca7c19a80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "tag": "7baee745-ba20-4859-9515-7a7e8632f1a6"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6d611ac5-6574-4d69-b818-47832409eb42 req-ddf5ec55-9f33-4e88-b2d6-17ca7c19a80f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6d611ac5-6574-4d69-b818-47832409eb42 req-ddf5ec55-9f33-4e88-b2d6-17ca7c19a80f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6d611ac5-6574-4d69-b818-47832409eb42 req-ddf5ec55-9f33-4e88-b2d6-17ca7c19a80f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6d611ac5-6574-4d69-b818-47832409eb42 req-ddf5ec55-9f33-4e88-b2d6-17ca7c19a80f service nova] Creating event network-changed:7baee745-ba20-4859-9515-7a7e8632f1a6 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:45:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6d611ac5-6574-4d69-b818-47832409eb42 req-ddf5ec55-9f33-4e88-b2d6-17ca7c19a80f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039479 Nov 27 01:45:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=37 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:49 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-168136f7-b9b5-4c05-bd3a-6e2ead24de6c tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab" status: 200 len: 1626 microversion: 2.49 time: 0.359229 Nov 27 01:45:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 39/119] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:45:49 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab => generated 1626 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:55 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20be68cb2665439facd51e94febfead1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bedf4fb8224abbae3e881366c6ddb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:45:55 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b2c3d5ad-7aa5-4de5-a524-a9304d7ec029 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad" status: 200 len: 1551 microversion: 2.1 time: 0.215707 Nov 27 01:45:55 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 41/120] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:45:55 2023] GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad => generated 1551 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:45:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-0d1fd906-4716-4f0d-88f8-386783edc99f req-176f2a56-ea0b-4da9-a422-3b40a0906f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "03f1300a-8159-45e6-9e84-0987d6d4b3a7"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d1fd906-4716-4f0d-88f8-386783edc99f req-176f2a56-ea0b-4da9-a422-3b40a0906f0c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d1fd906-4716-4f0d-88f8-386783edc99f req-176f2a56-ea0b-4da9-a422-3b40a0906f0c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d1fd906-4716-4f0d-88f8-386783edc99f req-176f2a56-ea0b-4da9-a422-3b40a0906f0c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:57 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-0d1fd906-4716-4f0d-88f8-386783edc99f req-176f2a56-ea0b-4da9-a422-3b40a0906f0c service nova] Creating event network-vif-plugged:03f1300a-8159-45e6-9e84-0987d6d4b3a7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:57 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-0d1fd906-4716-4f0d-88f8-386783edc99f req-176f2a56-ea0b-4da9-a422-3b40a0906f0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198014 Nov 27 01:45:57 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 41/121] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-dc703e1d-1f29-4e0e-aae7-fe48ae73b5e1 req-2c33b951-9eff-47b2-9d37-5e4ba99be07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "652be731-49dc-4bbf-b2c4-96ac294b1e2f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-dc703e1d-1f29-4e0e-aae7-fe48ae73b5e1 req-2c33b951-9eff-47b2-9d37-5e4ba99be07d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-dc703e1d-1f29-4e0e-aae7-fe48ae73b5e1 req-2c33b951-9eff-47b2-9d37-5e4ba99be07d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-dc703e1d-1f29-4e0e-aae7-fe48ae73b5e1 req-2c33b951-9eff-47b2-9d37-5e4ba99be07d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-dc703e1d-1f29-4e0e-aae7-fe48ae73b5e1 req-2c33b951-9eff-47b2-9d37-5e4ba99be07d service nova] Creating event network-vif-plugged:652be731-49dc-4bbf-b2c4-96ac294b1e2f for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-dc703e1d-1f29-4e0e-aae7-fe48ae73b5e1 req-2c33b951-9eff-47b2-9d37-5e4ba99be07d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070386 Nov 27 01:45:58 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "03f1300a-8159-45e6-9e84-0987d6d4b3a7"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "6575ac64-ee65-426c-9f6e-d12ec742e930"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "6575ac64-ee65-426c-9f6e-d12ec742e930"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "c700bd0a-6895-435d-a4c8-baba0bec47f7"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "c700bd0a-6895-435d-a4c8-baba0bec47f7"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Creating event network-vif-plugged:03f1300a-8159-45e6-9e84-0987d6d4b3a7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Creating event network-vif-plugged:6575ac64-ee65-426c-9f6e-d12ec742e930 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Creating event network-vif-plugged:6575ac64-ee65-426c-9f6e-d12ec742e930 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Creating event network-vif-plugged:c700bd0a-6895-435d-a4c8-baba0bec47f7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] Creating event network-vif-plugged:c700bd0a-6895-435d-a4c8-baba0bec47f7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-ba176112-a3de-4405-a462-9181f596aa7a req-e35320d6-e395-4fa2-8c4a-879a4e5249d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.093690 Nov 27 01:45:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 42/123] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:45:59 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-f2489f43-573f-43c3-8185-13f234dcef9e req-6dd40b39-c5c4-4849-9eee-6eda53459dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:45:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f2489f43-573f-43c3-8185-13f234dcef9e req-6dd40b39-c5c4-4849-9eee-6eda53459dfc service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:45:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f2489f43-573f-43c3-8185-13f234dcef9e req-6dd40b39-c5c4-4849-9eee-6eda53459dfc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:45:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f2489f43-573f-43c3-8185-13f234dcef9e req-6dd40b39-c5c4-4849-9eee-6eda53459dfc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:45:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-f2489f43-573f-43c3-8185-13f234dcef9e req-6dd40b39-c5c4-4849-9eee-6eda53459dfc service nova] Creating event network-vif-plugged:eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:45:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-f2489f43-573f-43c3-8185-13f234dcef9e req-6dd40b39-c5c4-4849-9eee-6eda53459dfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040728 Nov 27 01:45:59 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 42/124] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:46:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "652be731-49dc-4bbf-b2c4-96ac294b1e2f"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "56b01b62-5838-42d0-b238-f09531c57a0c"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "56b01b62-5838-42d0-b238-f09531c57a0c"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "5c48a087-d5b6-49ca-8842-9f9901638031"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "5c48a087-d5b6-49ca-8842-9f9901638031"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Creating event network-vif-plugged:652be731-49dc-4bbf-b2c4-96ac294b1e2f for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:46:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Creating event network-vif-plugged:56b01b62-5838-42d0-b238-f09531c57a0c for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:46:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Creating event network-vif-plugged:56b01b62-5838-42d0-b238-f09531c57a0c for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:46:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Creating event network-vif-plugged:5c48a087-d5b6-49ca-8842-9f9901638031 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:46:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] Creating event network-vif-plugged:5c48a087-d5b6-49ca-8842-9f9901638031 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:46:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-b5515861-f010-41e8-a74d-af31822391dc req-3ed4d0e1-5e32-432a-86e3-63dee7fb8df6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.044036 Nov 27 01:46:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:00 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:46:01 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-600f899b-b9ac-4911-9dce-b59ae98ac18b req-d429e5a0-3548-4b35-91f4-b8f05392df72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-600f899b-b9ac-4911-9dce-b59ae98ac18b req-d429e5a0-3548-4b35-91f4-b8f05392df72 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-600f899b-b9ac-4911-9dce-b59ae98ac18b req-d429e5a0-3548-4b35-91f4-b8f05392df72 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-600f899b-b9ac-4911-9dce-b59ae98ac18b req-d429e5a0-3548-4b35-91f4-b8f05392df72 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:01 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-600f899b-b9ac-4911-9dce-b59ae98ac18b req-d429e5a0-3548-4b35-91f4-b8f05392df72 service nova] Creating event network-vif-plugged:eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:46:01 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-600f899b-b9ac-4911-9dce-b59ae98ac18b req-d429e5a0-3548-4b35-91f4-b8f05392df72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Nov 27 01:46:01 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 43/126] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:02 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-3380db60-1d02-461b-b56a-5e08a8b131a3 req-574e2221-5034-46bc-bee5-dd277308407f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "25b7419f-d628-4926-b706-f066c254e9b1"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3380db60-1d02-461b-b56a-5e08a8b131a3 req-574e2221-5034-46bc-bee5-dd277308407f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3380db60-1d02-461b-b56a-5e08a8b131a3 req-574e2221-5034-46bc-bee5-dd277308407f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3380db60-1d02-461b-b56a-5e08a8b131a3 req-574e2221-5034-46bc-bee5-dd277308407f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-3380db60-1d02-461b-b56a-5e08a8b131a3 req-574e2221-5034-46bc-bee5-dd277308407f service nova] Creating event network-vif-plugged:25b7419f-d628-4926-b706-f066c254e9b1 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-3380db60-1d02-461b-b56a-5e08a8b131a3 req-574e2221-5034-46bc-bee5-dd277308407f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077486 Nov 27 01:46:02 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 43/127] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:03 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-af1703c3-d1f2-4e96-99a3-d1f64686d498 req-2745f79a-b93c-4cff-af7a-8fa96e536d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "b594e43e-af6b-49cd-92e0-12147106071d"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-af1703c3-d1f2-4e96-99a3-d1f64686d498 req-2745f79a-b93c-4cff-af7a-8fa96e536d13 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-af1703c3-d1f2-4e96-99a3-d1f64686d498 req-2745f79a-b93c-4cff-af7a-8fa96e536d13 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-af1703c3-d1f2-4e96-99a3-d1f64686d498 req-2745f79a-b93c-4cff-af7a-8fa96e536d13 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:03 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-af1703c3-d1f2-4e96-99a3-d1f64686d498 req-2745f79a-b93c-4cff-af7a-8fa96e536d13 service nova] Creating event network-vif-plugged:b594e43e-af6b-49cd-92e0-12147106071d for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:03 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-af1703c3-d1f2-4e96-99a3-d1f64686d498 req-2745f79a-b93c-4cff-af7a-8fa96e536d13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053323 Nov 27 01:46:03 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:04 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "25b7419f-d628-4926-b706-f066c254e9b1"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "1ec02ad7-a7a8-4602-942a-b66c57a56b0e"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "1ec02ad7-a7a8-4602-942a-b66c57a56b0e"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "0d99dd83-0e0d-4052-a410-d50b9102db65"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "0d99dd83-0e0d-4052-a410-d50b9102db65"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "58a0b7b7-ca5d-4889-9462-f3181c37db01"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "58a0b7b7-ca5d-4889-9462-f3181c37db01"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:25b7419f-d628-4926-b706-f066c254e9b1 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:1ec02ad7-a7a8-4602-942a-b66c57a56b0e for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:1ec02ad7-a7a8-4602-942a-b66c57a56b0e for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:0d99dd83-0e0d-4052-a410-d50b9102db65 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:0d99dd83-0e0d-4052-a410-d50b9102db65 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:58a0b7b7-ca5d-4889-9462-f3181c37db01 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] Creating event network-vif-plugged:58a0b7b7-ca5d-4889-9462-f3181c37db01 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-6801883c-27eb-4378-9a88-0ba08dc3b7ae req-2e4a0f2b-16af-4d9f-b13c-0bcd1f48819f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1551 microversion: 2.1 time: 0.063236 Nov 27 01:46:04 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 44/129] 10.0.0.210 () {68 vars in 1395 bytes} [Mon Nov 27 01:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 1551 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:46:04 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-c363f4c4-8e6e-46e8-ab24-11fd6d3d53ac req-8f261063-a6d7-4809-b1a8-1ab67007639c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "7baee745-ba20-4859-9515-7a7e8632f1a6"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c363f4c4-8e6e-46e8-ab24-11fd6d3d53ac req-8f261063-a6d7-4809-b1a8-1ab67007639c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c363f4c4-8e6e-46e8-ab24-11fd6d3d53ac req-8f261063-a6d7-4809-b1a8-1ab67007639c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c363f4c4-8e6e-46e8-ab24-11fd6d3d53ac req-8f261063-a6d7-4809-b1a8-1ab67007639c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:04 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c363f4c4-8e6e-46e8-ab24-11fd6d3d53ac req-8f261063-a6d7-4809-b1a8-1ab67007639c service nova] Creating event network-vif-plugged:7baee745-ba20-4859-9515-7a7e8632f1a6 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:04 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-c363f4c4-8e6e-46e8-ab24-11fd6d3d53ac req-8f261063-a6d7-4809-b1a8-1ab67007639c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061456 Nov 27 01:46:04 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:46:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-048b0bcc-321a-4c05-9506-52b442666076 req-d20b4e61-9e34-44b7-ab10-04881d5e99ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "b594e43e-af6b-49cd-92e0-12147106071d"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-048b0bcc-321a-4c05-9506-52b442666076 req-d20b4e61-9e34-44b7-ab10-04881d5e99ef service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-048b0bcc-321a-4c05-9506-52b442666076 req-d20b4e61-9e34-44b7-ab10-04881d5e99ef service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-048b0bcc-321a-4c05-9506-52b442666076 req-d20b4e61-9e34-44b7-ab10-04881d5e99ef service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-048b0bcc-321a-4c05-9506-52b442666076 req-d20b4e61-9e34-44b7-ab10-04881d5e99ef service nova] Creating event network-vif-plugged:b594e43e-af6b-49cd-92e0-12147106071d for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-048b0bcc-321a-4c05-9506-52b442666076 req-d20b4e61-9e34-44b7-ab10-04881d5e99ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035417 Nov 27 01:46:05 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 43/131] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:06 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-1f363848-a51a-4874-b709-0ccce85f6de7 req-1c9a523f-9f7c-4aff-9373-3ee95aec795f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "7baee745-ba20-4859-9515-7a7e8632f1a6"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-1f363848-a51a-4874-b709-0ccce85f6de7 req-1c9a523f-9f7c-4aff-9373-3ee95aec795f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-1f363848-a51a-4874-b709-0ccce85f6de7 req-1c9a523f-9f7c-4aff-9373-3ee95aec795f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-1f363848-a51a-4874-b709-0ccce85f6de7 req-1c9a523f-9f7c-4aff-9373-3ee95aec795f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:06 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-1f363848-a51a-4874-b709-0ccce85f6de7 req-1c9a523f-9f7c-4aff-9373-3ee95aec795f service nova] Creating event network-vif-plugged:7baee745-ba20-4859-9515-7a7e8632f1a6 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:46:06 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-1f363848-a51a-4874-b709-0ccce85f6de7 req-1c9a523f-9f7c-4aff-9373-3ee95aec795f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033330 Nov 27 01:46:06 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1596399690", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "5787a76f-5250-487c-9397-6a4bfd68e364"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] validate_networks() for [('5787a76f-5250-487c-9397-6a4bfd68e364', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Getting quotas for project 61df2ba0c7ea44b8b96ee810e90c3611. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Getting quotas for user ad1a32ce477e41df86f143a13989f498 and project 61df2ba0c7ea44b8b96ee810e90c3611. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:46:09 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:46:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a957a513-9083-4a10-888b-24838f7b1fef tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.517622 Nov 27 01:46:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 45/133] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:46:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:46:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0d908874-b7cb-4e0a-ad6b-048ca03cd593 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:09 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0d908874-b7cb-4e0a-ad6b-048ca03cd593 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:09 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0d908874-b7cb-4e0a-ad6b-048ca03cd593 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0d908874-b7cb-4e0a-ad6b-048ca03cd593 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53" status: 200 len: 1209 microversion: 2.1 time: 0.074677 Nov 27 01:46:09 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 44/134] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:46:09 2023] GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53 => generated 1209 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:46:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:10 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2d538394-11a3-47d6-8657-4df8f5541814 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.189059 Nov 27 01:46:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 46/135] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Nov 27 01:46:10 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-interface => generated 283 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:46:12 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-f67a8991-92a1-477c-a28c-bcabd438cb16 req-b4c1b455-8440-45f4-9ab4-7e74bec37d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f67a8991-92a1-477c-a28c-bcabd438cb16 req-b4c1b455-8440-45f4-9ab4-7e74bec37d78 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f67a8991-92a1-477c-a28c-bcabd438cb16 req-b4c1b455-8440-45f4-9ab4-7e74bec37d78 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f67a8991-92a1-477c-a28c-bcabd438cb16 req-b4c1b455-8440-45f4-9ab4-7e74bec37d78 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-f67a8991-92a1-477c-a28c-bcabd438cb16 req-b4c1b455-8440-45f4-9ab4-7e74bec37d78 service nova] Creating event network-changed:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:46:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-f67a8991-92a1-477c-a28c-bcabd438cb16 req-b4c1b455-8440-45f4-9ab4-7e74bec37d78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035015 Nov 27 01:46:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:12 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0739d5aa-9474-404d-af97-971bcc2d92c1 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/ips" status: 200 len: 111 microversion: 2.20 time: 0.081533 Nov 27 01:46:12 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 45/137] 10.0.0.210 () {64 vars in 1366 bytes} [Mon Nov 27 01:46:12 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/ips => generated 111 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:46:12 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:12 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:13 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-43f5b81a-6357-40a0-8919-f61a8a1d8b1a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.159178 Nov 27 01:46:13 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 47/138] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:46:12 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180/os-interface => generated 283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:13 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-f32778c2-efa2-4d8a-830a-a60a7f80716d req-43a69bee-0536-4388-8eb9-ab3422e80da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98831619-1f75-41ad-a5f8-52a3f9055d53", "tag": "0533611c-db34-46d1-92d0-6eeab5f1ddc1"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:13 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=5 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f32778c2-efa2-4d8a-830a-a60a7f80716d req-43a69bee-0536-4388-8eb9-ab3422e80da4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f32778c2-efa2-4d8a-830a-a60a7f80716d req-43a69bee-0536-4388-8eb9-ab3422e80da4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f32778c2-efa2-4d8a-830a-a60a7f80716d req-43a69bee-0536-4388-8eb9-ab3422e80da4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:13 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-f32778c2-efa2-4d8a-830a-a60a7f80716d req-43a69bee-0536-4388-8eb9-ab3422e80da4 service nova] Creating event network-changed:0533611c-db34-46d1-92d0-6eeab5f1ddc1 for instance 98831619-1f75-41ad-a5f8-52a3f9055d53 on user Nov 27 01:46:13 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-f32778c2-efa2-4d8a-830a-a60a7f80716d req-43a69bee-0536-4388-8eb9-ab3422e80da4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077649 Nov 27 01:46:13 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 47/139] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-723d0bff-ef65-482e-9f16-0c50e7e4e0da req-b177a5cb-ba44-4110-a376-219449a47375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163993f6-3b37-40ff-9372-37f866d28180", "tag": "2e93035c-a4c4-44f1-af80-c57fb2da8038"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-723d0bff-ef65-482e-9f16-0c50e7e4e0da req-b177a5cb-ba44-4110-a376-219449a47375 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-723d0bff-ef65-482e-9f16-0c50e7e4e0da req-b177a5cb-ba44-4110-a376-219449a47375 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-723d0bff-ef65-482e-9f16-0c50e7e4e0da req-b177a5cb-ba44-4110-a376-219449a47375 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-723d0bff-ef65-482e-9f16-0c50e7e4e0da req-b177a5cb-ba44-4110-a376-219449a47375 service nova] Creating event network-changed:2e93035c-a4c4-44f1-af80-c57fb2da8038 for instance 163993f6-3b37-40ff-9372-37f866d28180 on user Nov 27 01:46:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-723d0bff-ef65-482e-9f16-0c50e7e4e0da req-b177a5cb-ba44-4110-a376-219449a47375 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029314 Nov 27 01:46:14 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 48/140] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:14 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:14 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-e0ce30d1-2eb7-4ec3-972d-316385258a3c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1542 microversion: 2.1 time: 0.249331 Nov 27 01:46:14 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 46/141] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:46:14 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1542 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:14 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:14 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b3f84ad1-0320-44a2-b8a0-c5ef1884ea5d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1542 microversion: 2.1 time: 0.286716 Nov 27 01:46:14 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 48/142] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:46:14 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1542 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:15 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lazy-loading 'flavor' on Instance uuid ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:46:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:15 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lazy-loading 'flavor' on Instance uuid 7b992061-61c3-471b-b36d-d7c9ec57ddf6 {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:46:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5ece2544-65d1-4533-9d4e-09906ee7e565 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6/action" status: 200 len: 32 microversion: 2.1 time: 0.246967 Nov 27 01:46:15 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 49/143] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:46:15 2023] POST /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-001f27cd-cab9-45f7-87ec-796c290a1792 req-c38c8e6b-d037-4817-9642-afcc94c75e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98831619-1f75-41ad-a5f8-52a3f9055d53", "name": "network-vif-plugged", "status": "completed", "tag": "0533611c-db34-46d1-92d0-6eeab5f1ddc1"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-001f27cd-cab9-45f7-87ec-796c290a1792 req-c38c8e6b-d037-4817-9642-afcc94c75e28 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-001f27cd-cab9-45f7-87ec-796c290a1792 req-c38c8e6b-d037-4817-9642-afcc94c75e28 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-001f27cd-cab9-45f7-87ec-796c290a1792 req-c38c8e6b-d037-4817-9642-afcc94c75e28 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-001f27cd-cab9-45f7-87ec-796c290a1792 req-c38c8e6b-d037-4817-9642-afcc94c75e28 service nova] Creating event network-vif-plugged:0533611c-db34-46d1-92d0-6eeab5f1ddc1 for instance 98831619-1f75-41ad-a5f8-52a3f9055d53 on user Nov 27 01:46:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-001f27cd-cab9-45f7-87ec-796c290a1792 req-c38c8e6b-d037-4817-9642-afcc94c75e28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048958 Nov 27 01:46:15 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 50/144] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ba2a3b7b-380c-4739-9ba9-bc1a8585dd0d tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6" status: 200 len: 1507 microversion: 2.1 time: 0.256098 Nov 27 01:46:16 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 51/145] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:46:15 2023] GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:46:16 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:16 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:16 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:16 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-fc6e6174-8b7d-4223-9ff0-31d91fb26380 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c" status: 200 len: 2812 microversion: 2.32 time: 0.746721 Nov 27 01:46:16 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 47/146] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:46:15 2023] GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c => generated 2812 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:46:16 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0572202a-45cf-40e9-bc2c-24e2b88eb189 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/action" status: 202 len: 0 microversion: 2.20 time: 1.113482 Nov 27 01:46:16 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 49/147] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 01:46:15 2023] POST /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:16 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e8190f62-04c5-4956-92c4-4c541656688c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 200 len: 1710 microversion: 2.20 time: 0.469847 Nov 27 01:46:16 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 52/148] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:46:16 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 1710 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:46:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-ab929eba-1280-4998-b9a7-f6334def0ef0 req-aa2090d8-3aea-48d7-8195-a954e4f442ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98831619-1f75-41ad-a5f8-52a3f9055d53", "name": "network-vif-plugged", "status": "completed", "tag": "0533611c-db34-46d1-92d0-6eeab5f1ddc1"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ab929eba-1280-4998-b9a7-f6334def0ef0 req-aa2090d8-3aea-48d7-8195-a954e4f442ce service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ab929eba-1280-4998-b9a7-f6334def0ef0 req-aa2090d8-3aea-48d7-8195-a954e4f442ce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ab929eba-1280-4998-b9a7-f6334def0ef0 req-aa2090d8-3aea-48d7-8195-a954e4f442ce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-ab929eba-1280-4998-b9a7-f6334def0ef0 req-aa2090d8-3aea-48d7-8195-a954e4f442ce service nova] Creating event network-vif-plugged:0533611c-db34-46d1-92d0-6eeab5f1ddc1 for instance 98831619-1f75-41ad-a5f8-52a3f9055d53 on user Nov 27 01:46:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-ab929eba-1280-4998-b9a7-f6334def0ef0 req-aa2090d8-3aea-48d7-8195-a954e4f442ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031239 Nov 27 01:46:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 48/149] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:18 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-274524be-4fc2-473c-a639-c84174104904 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.169891 Nov 27 01:46:18 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:46:18 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:18 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-14a51932-75e7-499f-a0c5-46062988c81b req-185627e4-dbcc-47b0-842d-f2e429e888f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-unplugged", "status": "completed", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-14a51932-75e7-499f-a0c5-46062988c81b req-185627e4-dbcc-47b0-842d-f2e429e888f3 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-14a51932-75e7-499f-a0c5-46062988c81b req-185627e4-dbcc-47b0-842d-f2e429e888f3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-14a51932-75e7-499f-a0c5-46062988c81b req-185627e4-dbcc-47b0-842d-f2e429e888f3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-14a51932-75e7-499f-a0c5-46062988c81b req-185627e4-dbcc-47b0-842d-f2e429e888f3 service nova] Creating event network-vif-unplugged:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:46:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-14a51932-75e7-499f-a0c5-46062988c81b req-185627e4-dbcc-47b0-842d-f2e429e888f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071674 Nov 27 01:46:18 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 53/151] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-a3ca07b8-dcb1-4928-bec5-b73c1d234435 req-402e8a38-2c8b-49c0-b048-8d2e2dc2a8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a3ca07b8-dcb1-4928-bec5-b73c1d234435 req-402e8a38-2c8b-49c0-b048-8d2e2dc2a8e4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a3ca07b8-dcb1-4928-bec5-b73c1d234435 req-402e8a38-2c8b-49c0-b048-8d2e2dc2a8e4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a3ca07b8-dcb1-4928-bec5-b73c1d234435 req-402e8a38-2c8b-49c0-b048-8d2e2dc2a8e4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-a3ca07b8-dcb1-4928-bec5-b73c1d234435 req-402e8a38-2c8b-49c0-b048-8d2e2dc2a8e4 service nova] Creating event network-changed:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:46:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-a3ca07b8-dcb1-4928-bec5-b73c1d234435 req-402e8a38-2c8b-49c0-b048-8d2e2dc2a8e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127928 Nov 27 01:46:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 49/152] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1127790418"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:19 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:20 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:20 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:20 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-03a83e17-cc1a-476e-960a-c16d2caaa9ff req-53240366-475c-461b-8b4f-4fa7d16095b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-unplugged", "status": "completed", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}, {"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-03a83e17-cc1a-476e-960a-c16d2caaa9ff req-53240366-475c-461b-8b4f-4fa7d16095b8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-03a83e17-cc1a-476e-960a-c16d2caaa9ff req-53240366-475c-461b-8b4f-4fa7d16095b8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-03a83e17-cc1a-476e-960a-c16d2caaa9ff req-53240366-475c-461b-8b4f-4fa7d16095b8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-03a83e17-cc1a-476e-960a-c16d2caaa9ff req-53240366-475c-461b-8b4f-4fa7d16095b8 service nova] Creating event network-vif-unplugged:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 01:46:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-03a83e17-cc1a-476e-960a-c16d2caaa9ff req-53240366-475c-461b-8b4f-4fa7d16095b8 service nova] Creating event network-vif-plugged:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 01:46:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-03a83e17-cc1a-476e-960a-c16d2caaa9ff req-53240366-475c-461b-8b4f-4fa7d16095b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.071480 Nov 27 01:46:20 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 54/153] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:20 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-284d2c02-f5f7-4ae0-a253-c2cd1d9ba623 req-02d77ed3-b92f-4cba-b285-d78ec4c49a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-plugged", "status": "completed", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:20 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-284d2c02-f5f7-4ae0-a253-c2cd1d9ba623 req-02d77ed3-b92f-4cba-b285-d78ec4c49a38 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-284d2c02-f5f7-4ae0-a253-c2cd1d9ba623 req-02d77ed3-b92f-4cba-b285-d78ec4c49a38 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-284d2c02-f5f7-4ae0-a253-c2cd1d9ba623 req-02d77ed3-b92f-4cba-b285-d78ec4c49a38 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-284d2c02-f5f7-4ae0-a253-c2cd1d9ba623 req-02d77ed3-b92f-4cba-b285-d78ec4c49a38 service nova] Creating event network-vif-plugged:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:46:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-284d2c02-f5f7-4ae0-a253-c2cd1d9ba623 req-02d77ed3-b92f-4cba-b285-d78ec4c49a38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047920 Nov 27 01:46:20 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 50/154] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-052f7c41-9a14-4f3b-ba44-2e4d4fb03416 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "POST /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/action" status: 202 len: 0 microversion: 2.1 time: 1.575356 Nov 27 01:46:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 51/155] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:46:19 2023] POST /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/action => generated 0 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 27 01:46:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-08903e94-c5f4-43fc-ba25-78819f59c7c0 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '.version_select at 0x7f364b8dc310>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-08903e94-c5f4-43fc-ba25-78819f59c7c0 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/images/67d9107c-79bc-4e26-bdb3-5cb69980ffb0" status: 200 len: 1611 microversion: 2.1 time: 0.146827 Nov 27 01:46:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 55/156] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Nov 27 01:46:21 2023] GET /compute/v2.1/images/67d9107c-79bc-4e26-bdb3-5cb69980ffb0 => generated 1611 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:22 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:22 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:22 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9ad7a472-9dbb-4e27-b0ca-d7d1bae35663 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92" status: 200 len: 2819 microversion: 2.42 time: 0.488777 Nov 27 01:46:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 51/157] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:46:21 2023] GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 => generated 2819 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:46:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-a756ec08-573d-4cd7-bc34-14da76be6627 req-99183a87-6d53-42c5-ad58-f587b3db85f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a756ec08-573d-4cd7-bc34-14da76be6627 req-99183a87-6d53-42c5-ad58-f587b3db85f9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a756ec08-573d-4cd7-bc34-14da76be6627 req-99183a87-6d53-42c5-ad58-f587b3db85f9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a756ec08-573d-4cd7-bc34-14da76be6627 req-99183a87-6d53-42c5-ad58-f587b3db85f9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-a756ec08-573d-4cd7-bc34-14da76be6627 req-99183a87-6d53-42c5-ad58-f587b3db85f9 service nova] Creating event network-vif-plugged:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 01:46:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-a756ec08-573d-4cd7-bc34-14da76be6627 req-99183a87-6d53-42c5-ad58-f587b3db85f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031665 Nov 27 01:46:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 52/158] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:24 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-2979cc44-e8ac-4d07-a1f1-2e000079ecf6 req-ca2f83d6-9c8a-4d0c-80bb-b7655dd198af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2979cc44-e8ac-4d07-a1f1-2e000079ecf6 req-ca2f83d6-9c8a-4d0c-80bb-b7655dd198af service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2979cc44-e8ac-4d07-a1f1-2e000079ecf6 req-ca2f83d6-9c8a-4d0c-80bb-b7655dd198af service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2979cc44-e8ac-4d07-a1f1-2e000079ecf6 req-ca2f83d6-9c8a-4d0c-80bb-b7655dd198af service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-2979cc44-e8ac-4d07-a1f1-2e000079ecf6 req-ca2f83d6-9c8a-4d0c-80bb-b7655dd198af service nova] Creating event network-vif-plugged:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 01:46:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-2979cc44-e8ac-4d07-a1f1-2e000079ecf6 req-ca2f83d6-9c8a-4d0c-80bb-b7655dd198af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122540 Nov 27 01:46:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 56/159] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] [instance: 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:25 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a974479967c4720817ccac8161d3fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94532ed6cedd4a158f8f3a9099c6c76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-424bd6ef-66f9-4fdf-b2b9-a6d2be6383ae tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68" status: 200 len: 1451 microversion: 2.1 time: 0.259229 Nov 27 01:46:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 52/160] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:46:25 2023] GET /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 => generated 1451 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:46:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-24891389-095d-4373-8173-efa03da69bad req-d8145f35-3c2b-424d-bd4c-960e1cdf6867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-24891389-095d-4373-8173-efa03da69bad req-d8145f35-3c2b-424d-bd4c-960e1cdf6867 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-24891389-095d-4373-8173-efa03da69bad req-d8145f35-3c2b-424d-bd4c-960e1cdf6867 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-24891389-095d-4373-8173-efa03da69bad req-d8145f35-3c2b-424d-bd4c-960e1cdf6867 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.compute.server_external_events [req-24891389-095d-4373-8173-efa03da69bad req-d8145f35-3c2b-424d-bd4c-960e1cdf6867 service nova] Unable to find a host for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4. Dropping event network-changed {{(pid=65194) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 27 01:46:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-24891389-095d-4373-8173-efa03da69bad req-d8145f35-3c2b-424d-bd4c-960e1cdf6867 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 176 microversion: 2.1 time: 0.038769 Nov 27 01:46:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:26 2023] POST /compute/v2.1/os-server-external-events => generated 176 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=17 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:38 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-1aef5463-24d1-4f1c-88d0-0539f6d9f2d5 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.151217 Nov 27 01:46:38 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 57/162] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:46:38 2023] GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-interface => generated 282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:39 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-f623085e-9bbc-4261-833e-0f545a523051 req-f2b8385f-1c9a-415e-bcfb-c7f5946d20be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c1f4ed-6972-47f9-8578-4105ce4d7df8", "tag": "4f81c4fe-650f-481d-93ef-8b0e523d0f28"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:39 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:39 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=47 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f623085e-9bbc-4261-833e-0f545a523051 req-f2b8385f-1c9a-415e-bcfb-c7f5946d20be service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f623085e-9bbc-4261-833e-0f545a523051 req-f2b8385f-1c9a-415e-bcfb-c7f5946d20be service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f623085e-9bbc-4261-833e-0f545a523051 req-f2b8385f-1c9a-415e-bcfb-c7f5946d20be service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-f623085e-9bbc-4261-833e-0f545a523051 req-f2b8385f-1c9a-415e-bcfb-c7f5946d20be service nova] Creating event network-changed:4f81c4fe-650f-481d-93ef-8b0e523d0f28 for instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 on user Nov 27 01:46:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-f623085e-9bbc-4261-833e-0f545a523051 req-f2b8385f-1c9a-415e-bcfb-c7f5946d20be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032980 Nov 27 01:46:39 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 53/163] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=27 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-eb0d62cc-ec9e-4efc-b06a-9809bde3cf9c tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.136433 Nov 27 01:46:41 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 54/164] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:46:41 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-interface => generated 283 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a49e64b-f374-4271-b762-69ff76efdaf9"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-fe4200de-88c3-4b27-b0dc-6c5852e3ea93 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "POST /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533109 Nov 27 01:46:42 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 58/165] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:46:41 2023] POST /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:42 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-2bad37a0-942c-4401-98e8-25f9ee8edaae req-8c7681ad-aa61-4ecd-a2ae-b8d0c965d586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b8c121-240d-46f2-9e10-fdfb14753018", "tag": "f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2bad37a0-942c-4401-98e8-25f9ee8edaae req-8c7681ad-aa61-4ecd-a2ae-b8d0c965d586 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2bad37a0-942c-4401-98e8-25f9ee8edaae req-8c7681ad-aa61-4ecd-a2ae-b8d0c965d586 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2bad37a0-942c-4401-98e8-25f9ee8edaae req-8c7681ad-aa61-4ecd-a2ae-b8d0c965d586 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-2bad37a0-942c-4401-98e8-25f9ee8edaae req-8c7681ad-aa61-4ecd-a2ae-b8d0c965d586 service nova] Creating event network-changed:f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa for instance 32b8c121-240d-46f2-9e10-fdfb14753018 on user Nov 27 01:46:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-2bad37a0-942c-4401-98e8-25f9ee8edaae req-8c7681ad-aa61-4ecd-a2ae-b8d0c965d586 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029894 Nov 27 01:46:42 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 54/166] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:42 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df37566-8a7e-402b-b5a9-5e734240fde6"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:42 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-50038e39-c954-4305-a071-86e80c3fec78 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "POST /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367483 Nov 27 01:46:42 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 55/167] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:46:42 2023] POST /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:49 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:49 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:49 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4d0ef833-9caa-474a-b05a-5a22fa51a203 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.155215 Nov 27 01:46:49 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 59/168] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Nov 27 01:46:49 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-interface => generated 282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:46:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-029b9dee-e847-41ad-9073-940386e621de req-80d3ca05-9e9f-4dd5-bb6e-24088bcf4f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "tag": "e8111c75-793e-4e5b-9d85-f3ea893a780e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-029b9dee-e847-41ad-9073-940386e621de req-80d3ca05-9e9f-4dd5-bb6e-24088bcf4f32 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-029b9dee-e847-41ad-9073-940386e621de req-80d3ca05-9e9f-4dd5-bb6e-24088bcf4f32 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-029b9dee-e847-41ad-9073-940386e621de req-80d3ca05-9e9f-4dd5-bb6e-24088bcf4f32 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-029b9dee-e847-41ad-9073-940386e621de req-80d3ca05-9e9f-4dd5-bb6e-24088bcf4f32 service nova] Creating event network-changed:e8111c75-793e-4e5b-9d85-f3ea893a780e for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:46:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-029b9dee-e847-41ad-9073-940386e621de req-80d3ca05-9e9f-4dd5-bb6e-24088bcf4f32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051840 Nov 27 01:46:50 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 55/169] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:50 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:46:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4af5492f-5368-493c-80af-9bf678e8ddf4 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab" status: 200 len: 1626 microversion: 2.49 time: 0.306624 Nov 27 01:46:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 56/170] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:46:50 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab => generated 1626 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:46:50 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "a6604726-1c81-4069-9756-6155913073f5", "tag": "nic-tag"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:50 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c02bfc9a-7fb1-4c91-b88f-9b459c447dba"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] HTTP exception thrown: Volume c02bfc9a-7fb1-4c91-b88f-9b459c447dba could not be found. Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Returning 400 to user: Volume c02bfc9a-7fb1-4c91-b88f-9b459c447dba could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:46:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0a244086-d2a5-4aa1-b12f-a21bb3f017d1 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments/4a49e64b-f374-4271-b762-69ff76efdaf9" status: 400 len: 107 microversion: 2.1 time: 0.443637 Nov 27 01:46:52 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 56/171] 10.0.0.210 () {64 vars in 1510 bytes} [Mon Nov 27 01:46:51 2023] PUT /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments/4a49e64b-f374-4271-b762-69ff76efdaf9 => generated 107 bytes in 446 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-86234632-69f9-4be1-aadd-c4246ff521e5 req-ce747784-fd5a-4617-98c7-873cb6fda19c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "tag": "90c7abb2-8b81-4847-b632-6403dc3ff8ae"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-86234632-69f9-4be1-aadd-c4246ff521e5 req-ce747784-fd5a-4617-98c7-873cb6fda19c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-86234632-69f9-4be1-aadd-c4246ff521e5 req-ce747784-fd5a-4617-98c7-873cb6fda19c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-86234632-69f9-4be1-aadd-c4246ff521e5 req-ce747784-fd5a-4617-98c7-873cb6fda19c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-86234632-69f9-4be1-aadd-c4246ff521e5 req-ce747784-fd5a-4617-98c7-873cb6fda19c service nova] Creating event network-changed:90c7abb2-8b81-4847-b632-6403dc3ff8ae for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:46:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-86234632-69f9-4be1-aadd-c4246ff521e5 req-ce747784-fd5a-4617-98c7-873cb6fda19c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030457 Nov 27 01:46:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 57/172] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:46:52 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lazy-loading 'services' on Instance uuid 58c1f4ed-6972-47f9-8578-4105ce4d7df8 {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:46:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-f704d91f-7290-46e0-9ebc-9793192e6836 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments/4a49e64b-f374-4271-b762-69ff76efdaf9" status: 202 len: 0 microversion: 2.1 time: 0.281882 Nov 27 01:46:52 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:46:52 2023] DELETE /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments/4a49e64b-f374-4271-b762-69ff76efdaf9 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4cb67544-7b3a-4fb4-810f-f7c1789b2c03 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055066 Nov 27 01:46:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:46:52 2023] GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:46:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-ba1ab39f-b6a8-41ba-8125-4cd73c35f932 req-4f9ada1b-3305-4b1c-a9a4-050e79da9244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-plugged", "status": "completed", "tag": "90c7abb2-8b81-4847-b632-6403dc3ff8ae"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ba1ab39f-b6a8-41ba-8125-4cd73c35f932 req-4f9ada1b-3305-4b1c-a9a4-050e79da9244 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ba1ab39f-b6a8-41ba-8125-4cd73c35f932 req-4f9ada1b-3305-4b1c-a9a4-050e79da9244 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ba1ab39f-b6a8-41ba-8125-4cd73c35f932 req-4f9ada1b-3305-4b1c-a9a4-050e79da9244 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ba1ab39f-b6a8-41ba-8125-4cd73c35f932 req-4f9ada1b-3305-4b1c-a9a4-050e79da9244 service nova] Creating event network-vif-plugged:90c7abb2-8b81-4847-b632-6403dc3ff8ae for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:46:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-ba1ab39f-b6a8-41ba-8125-4cd73c35f932 req-4f9ada1b-3305-4b1c-a9a4-050e79da9244 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029151 Nov 27 01:46:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d36405d7-5716-4f6f-a55f-b623cbc37e14"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:53 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-daed90f0-5bd5-49ff-964e-6d7de28d7237 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments/8df37566-8a7e-402b-b5a9-5e734240fde6" status: 202 len: 0 microversion: 2.1 time: 0.450161 Nov 27 01:46:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 58/176] 10.0.0.210 () {64 vars in 1510 bytes} [Mon Nov 27 01:46:53 2023] PUT /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments/8df37566-8a7e-402b-b5a9-5e734240fde6 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:46:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9127852b-1492-4c12-9454-2c80eac1d218 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "POST /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-interface" status: 200 len: 281 microversion: 2.49 time: 3.077252 Nov 27 01:46:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 60/177] 10.0.0.210 () {66 vars in 1414 bytes} [Mon Nov 27 01:46:50 2023] POST /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-interface => generated 281 bytes in 3079 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:46:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fff07356-2306-4b04-83c0-871e1dca7b0a", "tag": "volume-tag"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:54 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a99aefc3-f33d-48ff-bd27-dd00aab174f0 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "POST /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.314641 Nov 27 01:46:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 60/178] 10.0.0.210 () {66 vars in 1441 bytes} [Mon Nov 27 01:46:54 2023] POST /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:46:55 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-e08a5f6d-83e1-4e80-8a8d-e214996dd235 req-dea0e0a1-41a2-4cf8-925a-7fff9cdcdb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-plugged", "status": "completed", "tag": "90c7abb2-8b81-4847-b632-6403dc3ff8ae"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e08a5f6d-83e1-4e80-8a8d-e214996dd235 req-dea0e0a1-41a2-4cf8-925a-7fff9cdcdb24 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e08a5f6d-83e1-4e80-8a8d-e214996dd235 req-dea0e0a1-41a2-4cf8-925a-7fff9cdcdb24 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e08a5f6d-83e1-4e80-8a8d-e214996dd235 req-dea0e0a1-41a2-4cf8-925a-7fff9cdcdb24 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e08a5f6d-83e1-4e80-8a8d-e214996dd235 req-dea0e0a1-41a2-4cf8-925a-7fff9cdcdb24 service nova] Creating event network-vif-plugged:90c7abb2-8b81-4847-b632-6403dc3ff8ae for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:46:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-e08a5f6d-83e1-4e80-8a8d-e214996dd235 req-dea0e0a1-41a2-4cf8-925a-7fff9cdcdb24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030159 Nov 27 01:46:55 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 59/179] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:56 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:56 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:56 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-eb198e01-5076-424a-8f98-523a5d0e22a6 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.137822 Nov 27 01:46:56 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 61/180] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:46:56 2023] GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-interface => generated 283 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d1371ca-ddda-468b-845c-58206df60c53"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:57 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:46:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0ebeabec-33f9-4a2c-bf9f-56c8eb448faa tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] 10.0.0.210 "POST /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361859 Nov 27 01:46:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 61/181] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:46:57 2023] POST /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-f547d2db-f87d-43d9-93a7-c9798b458baa req-17c24fc2-e72a-43d9-be01-19b6651f7dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3ea204-3973-4a37-924b-b09cd19b7fad", "tag": "5c0af32c-d4a0-475d-8ed8-89c716bc2925"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:46:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f547d2db-f87d-43d9-93a7-c9798b458baa req-17c24fc2-e72a-43d9-be01-19b6651f7dae service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:46:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f547d2db-f87d-43d9-93a7-c9798b458baa req-17c24fc2-e72a-43d9-be01-19b6651f7dae service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:46:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f547d2db-f87d-43d9-93a7-c9798b458baa req-17c24fc2-e72a-43d9-be01-19b6651f7dae service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:46:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-f547d2db-f87d-43d9-93a7-c9798b458baa req-17c24fc2-e72a-43d9-be01-19b6651f7dae service nova] Creating event network-changed:5c0af32c-d4a0-475d-8ed8-89c716bc2925 for instance eb3ea204-3973-4a37-924b-b09cd19b7fad on user Nov 27 01:46:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-f547d2db-f87d-43d9-93a7-c9798b458baa req-17c24fc2-e72a-43d9-be01-19b6651f7dae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050390 Nov 27 01:46:57 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 60/182] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:46:59 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:46:59 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:00 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-afe6c264-af10-454c-a30c-f89816986fd2 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53" status: 200 len: 1492 microversion: 2.1 time: 0.217567 Nov 27 01:47:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 62/183] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:46:59 2023] GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53 => generated 1492 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:04 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:04 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:05 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:05 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-19234dc8-fc4f-4d29-902e-32f3740ed59d tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1661 microversion: 2.1 time: 0.323130 Nov 27 01:47:05 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 62/184] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:47:04 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1661 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:05 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3180e597-12b7-4f02-acdc-334464e60a16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1661 microversion: 2.1 time: 0.206092 Nov 27 01:47:05 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 61/185] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:47:05 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1661 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:06 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lazy-loading 'services' on Instance uuid 21f94cb8-8808-4426-b97b-b337932e49ab {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:47:06 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b1a9bd73-0371-4ee9-ad65-e2211ba4c058 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-volume_attachments/fff07356-2306-4b04-83c0-871e1dca7b0a" status: 202 len: 0 microversion: 2.49 time: 0.263824 Nov 27 01:47:06 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 63/186] 10.0.0.210 () {64 vars in 1534 bytes} [Mon Nov 27 01:47:06 2023] DELETE /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-volume_attachments/fff07356-2306-4b04-83c0-871e1dca7b0a => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:47:06 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:06 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-679c2020-dfce-41d5-a674-d2d76b8dc5ee tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6" status: 200 len: 1487 microversion: 2.1 time: 0.462271 Nov 27 01:47:06 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 63/187] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:47:06 2023] GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6 => generated 1487 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:06 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:06 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:07 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:07 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:07 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:07 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4e10c679-7af9-4644-b816-1e58e66426d0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 200 len: 1651 microversion: 2.20 time: 0.193659 Nov 27 01:47:07 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 62/188] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:47:06 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 1651 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "6d1371ca-ddda-468b-845c-58206df60c53", "create_info": {"snapshot_id": "784ee048-152c-4cab-86b2-2ea259121b35", "type": "qcow2", "new_file": "new_file"}}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2205dd81-f9af-4c80-b3d5-3db97aa991c0(cell1) {{(pid=65194) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-90a8a016-6921-416e-873a-5ad0dabb2a4b tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] 10.0.0.210 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.220074 Nov 27 01:47:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 64/189] 10.0.0.210 () {64 vars in 1287 bytes} [Mon Nov 27 01:47:07 2023] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:47:08 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:08 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2205dd81-f9af-4c80-b3d5-3db97aa991c0(cell1) {{(pid=65192) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 27 01:47:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:08 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-1e41a9c1-7a2e-490f-944e-4f84a71cbbd3 tempest-VolumesAssistedSnapshotsTest-289546077 tempest-VolumesAssistedSnapshotsTest-289546077-project] 10.0.0.210 "DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%226d1371ca-ddda-468b-845c-58206df60c53%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.075331 Nov 27 01:47:08 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 64/190] 10.0.0.210 () {62 vars in 1442 bytes} [Mon Nov 27 01:47:08 2023] DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%226d1371ca-ddda-468b-845c-58206df60c53%22%7D => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:08 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lazy-loading 'services' on Instance uuid eb3ea204-3973-4a37-924b-b09cd19b7fad {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:47:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-2d96e983-892b-47c1-8bb0-e3c107e3330f tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] 10.0.0.210 "DELETE /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-volume_attachments/6d1371ca-ddda-468b-845c-58206df60c53" status: 202 len: 0 microversion: 2.1 time: 0.241802 Nov 27 01:47:08 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 63/191] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:47:08 2023] DELETE /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-volume_attachments/6d1371ca-ddda-468b-845c-58206df60c53 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8ccfeb3e-a659-4a0a-b175-a2bdfe5fb078 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042148 Nov 27 01:47:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:47:08 2023] GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:09 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-94ce5ee0-7fe7-4b63-a251-7de0ab58e63e tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Nov 27 01:47:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 65/193] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:47:09 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:09 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-02bbc9a0-695d-4803-af9b-030b4d535ec1 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049017 Nov 27 01:47:09 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:47:09 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8df37566-8a7e-402b-b5a9-5e734240fde6"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:09 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0a518195-b5de-41d0-8255-903ed2a26158 tempest-TestVolumeSwap-262078716 tempest-TestVolumeSwap-262078716-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments/d36405d7-5716-4f6f-a55f-b623cbc37e14" status: 202 len: 0 microversion: 2.1 time: 0.269973 Nov 27 01:47:09 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 66/195] 10.0.0.210 () {64 vars in 1510 bytes} [Mon Nov 27 01:47:09 2023] PUT /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments/d36405d7-5716-4f6f-a55f-b623cbc37e14 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:47:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-caec87f9-d3a4-454d-977d-e8a8a76becb5 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '.version_select at 0x7f364b65ecb0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-caec87f9-d3a4-454d-977d-e8a8a76becb5 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/images/67d9107c-79bc-4e26-bdb3-5cb69980ffb0" status: 200 len: 1725 microversion: 2.1 time: 0.068299 Nov 27 01:47:11 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 66/196] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Nov 27 01:47:11 2023] GET /compute/v2.1/images/67d9107c-79bc-4e26-bdb3-5cb69980ffb0 => generated 1725 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:11 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c34b6173-aa91-42a5-a2cf-dbc4d00aaf31 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '.version_select at 0x7f364b732170>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c34b6173-aa91-42a5-a2cf-dbc4d00aaf31 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/images/67d9107c-79bc-4e26-bdb3-5cb69980ffb0" status: 200 len: 1725 microversion: 2.1 time: 0.107130 Nov 27 01:47:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Nov 27 01:47:11 2023] GET /compute/v2.1/images/67d9107c-79bc-4e26-bdb3-5cb69980ffb0 => generated 1725 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:11 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990555ee1c2a4bfa9858705701a49079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954c903a669a46feadbf6b78531c6639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c488f6a1-8b14-4b73-bb23-218da879904f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 200 len: 1669 microversion: 2.1 time: 0.206030 Nov 27 01:47:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:47:11 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 1669 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:16 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:16 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4778de61-337c-4a6f-9230-46c55f5dfdcc tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.364869 Nov 27 01:47:16 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 67/199] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Nov 27 01:47:16 2023] GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c/os-interface => generated 1829 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-83960958-da46-49f5-be82-a5c13ac6a681 req-8556eab3-4da0-4a41-92ba-a9461e5e333c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "tag": "03f1300a-8159-45e6-9e84-0987d6d4b3a7"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-83960958-da46-49f5-be82-a5c13ac6a681 req-8556eab3-4da0-4a41-92ba-a9461e5e333c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-83960958-da46-49f5-be82-a5c13ac6a681 req-8556eab3-4da0-4a41-92ba-a9461e5e333c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-83960958-da46-49f5-be82-a5c13ac6a681 req-8556eab3-4da0-4a41-92ba-a9461e5e333c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-83960958-da46-49f5-be82-a5c13ac6a681 req-8556eab3-4da0-4a41-92ba-a9461e5e333c service nova] Creating event network-changed:03f1300a-8159-45e6-9e84-0987d6d4b3a7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-83960958-da46-49f5-be82-a5c13ac6a681 req-8556eab3-4da0-4a41-92ba-a9461e5e333c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036840 Nov 27 01:47:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 66/200] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:17 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:17 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0beffe7e-7e18-4a6f-b174-41bc2d7dc313 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c" status: 200 len: 2812 microversion: 2.32 time: 0.376879 Nov 27 01:47:17 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 68/201] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:47:17 2023] GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c => generated 2812 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:17 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-8c80b9e7-8b56-451e-bf6b-e140a0b58df2 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.141511 Nov 27 01:47:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 68/202] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Nov 27 01:47:17 2023] GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c/os-interface => generated 1829 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:47:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-547f4d38-ee48-4027-a811-3c33ab8a6548 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c" status: 204 len: 0 microversion: 2.32 time: 0.221332 Nov 27 01:47:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 67/203] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:47:19 2023] DELETE /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:20 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:20 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:20 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '499d3567379a458185cf3f72f4633c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879d7e83642942bcb4262bc9332cf6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ac9b7629-605e-4f32-b4cc-9dae2846542f tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c" status: 200 len: 2936 microversion: 2.32 time: 0.343904 Nov 27 01:47:20 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:47:19 2023] GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c => generated 2936 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:20 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:20 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-4e339f27-33a4-46c4-bb41-f7d295158465 req-ae7697d1-061c-43b4-bab5-7fcbdce5209b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-unplugged", "status": "completed", "tag": "03f1300a-8159-45e6-9e84-0987d6d4b3a7"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e339f27-33a4-46c4-bb41-f7d295158465 req-ae7697d1-061c-43b4-bab5-7fcbdce5209b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e339f27-33a4-46c4-bb41-f7d295158465 req-ae7697d1-061c-43b4-bab5-7fcbdce5209b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e339f27-33a4-46c4-bb41-f7d295158465 req-ae7697d1-061c-43b4-bab5-7fcbdce5209b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4e339f27-33a4-46c4-bb41-f7d295158465 req-ae7697d1-061c-43b4-bab5-7fcbdce5209b service nova] Creating event network-vif-unplugged:03f1300a-8159-45e6-9e84-0987d6d4b3a7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-4e339f27-33a4-46c4-bb41-f7d295158465 req-ae7697d1-061c-43b4-bab5-7fcbdce5209b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049117 Nov 27 01:47:20 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 69/205] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:20 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-38ee0b93-ccad-4426-9aad-4bee2af4e63f req-5cb91cd6-95ba-405b-853e-db37b0b73bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-unplugged", "status": "completed", "tag": "652be731-49dc-4bbf-b2c4-96ac294b1e2f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-38ee0b93-ccad-4426-9aad-4bee2af4e63f req-5cb91cd6-95ba-405b-853e-db37b0b73bc2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-38ee0b93-ccad-4426-9aad-4bee2af4e63f req-5cb91cd6-95ba-405b-853e-db37b0b73bc2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-38ee0b93-ccad-4426-9aad-4bee2af4e63f req-5cb91cd6-95ba-405b-853e-db37b0b73bc2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-38ee0b93-ccad-4426-9aad-4bee2af4e63f req-5cb91cd6-95ba-405b-853e-db37b0b73bc2 service nova] Creating event network-vif-unplugged:652be731-49dc-4bbf-b2c4-96ac294b1e2f for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-38ee0b93-ccad-4426-9aad-4bee2af4e63f req-5cb91cd6-95ba-405b-853e-db37b0b73bc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050124 Nov 27 01:47:20 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c227b28b-264b-4986-93af-1abee3f67f8c req-33ac53cf-4316-418c-beed-3ba5dc58591f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-unplugged", "status": "completed", "tag": "eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c227b28b-264b-4986-93af-1abee3f67f8c req-33ac53cf-4316-418c-beed-3ba5dc58591f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c227b28b-264b-4986-93af-1abee3f67f8c req-33ac53cf-4316-418c-beed-3ba5dc58591f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c227b28b-264b-4986-93af-1abee3f67f8c req-33ac53cf-4316-418c-beed-3ba5dc58591f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-c227b28b-264b-4986-93af-1abee3f67f8c req-33ac53cf-4316-418c-beed-3ba5dc58591f service nova] Creating event network-vif-unplugged:eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c227b28b-264b-4986-93af-1abee3f67f8c req-33ac53cf-4316-418c-beed-3ba5dc58591f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043505 Nov 27 01:47:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 70/207] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "03f1300a-8159-45e6-9e84-0987d6d4b3a7"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-unplugged", "status": "completed", "tag": "6575ac64-ee65-426c-9f6e-d12ec742e930"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "6575ac64-ee65-426c-9f6e-d12ec742e930"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-unplugged", "status": "completed", "tag": "c700bd0a-6895-435d-a4c8-baba0bec47f7"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "c700bd0a-6895-435d-a4c8-baba0bec47f7"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Creating event network-vif-plugged:03f1300a-8159-45e6-9e84-0987d6d4b3a7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Creating event network-vif-unplugged:6575ac64-ee65-426c-9f6e-d12ec742e930 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Creating event network-vif-plugged:6575ac64-ee65-426c-9f6e-d12ec742e930 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Creating event network-vif-unplugged:c700bd0a-6895-435d-a4c8-baba0bec47f7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] Creating event network-vif-plugged:c700bd0a-6895-435d-a4c8-baba0bec47f7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-c6af2944-cf34-4a13-83b9-3494e9143f6f req-8a62ea8a-4253-486e-8b88-2fefb0482d7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.038813 Nov 27 01:47:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:22 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:22 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:22 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "652be731-49dc-4bbf-b2c4-96ac294b1e2f"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-unplugged", "status": "completed", "tag": "56b01b62-5838-42d0-b238-f09531c57a0c"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "56b01b62-5838-42d0-b238-f09531c57a0c"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-unplugged", "status": "completed", "tag": "5c48a087-d5b6-49ca-8842-9f9901638031"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "5c48a087-d5b6-49ca-8842-9f9901638031"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Creating event network-vif-plugged:652be731-49dc-4bbf-b2c4-96ac294b1e2f for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Creating event network-vif-unplugged:56b01b62-5838-42d0-b238-f09531c57a0c for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Creating event network-vif-plugged:56b01b62-5838-42d0-b238-f09531c57a0c for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Creating event network-vif-unplugged:5c48a087-d5b6-49ca-8842-9f9901638031 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] Creating event network-vif-plugged:5c48a087-d5b6-49ca-8842-9f9901638031 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-27416d06-65b7-4d4b-8136-023ee066e79d req-2e6569ba-22a9-40f1-8762-4cc55d6ae809 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.054909 Nov 27 01:47:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 71/209] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:22 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-eb74b98c-d763-463f-9622-8e819df0d08d tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.466982 Nov 27 01:47:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 69/210] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Nov 27 01:47:22 2023] GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92/os-interface => generated 1830 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:23 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-5bf280bb-8c7f-4d27-9a5e-2d5341164c11 req-4efd396d-cd65-4dad-b7ab-1c5ec75d53c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-plugged", "status": "completed", "tag": "eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5bf280bb-8c7f-4d27-9a5e-2d5341164c11 req-4efd396d-cd65-4dad-b7ab-1c5ec75d53c7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5bf280bb-8c7f-4d27-9a5e-2d5341164c11 req-4efd396d-cd65-4dad-b7ab-1c5ec75d53c7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5bf280bb-8c7f-4d27-9a5e-2d5341164c11 req-4efd396d-cd65-4dad-b7ab-1c5ec75d53c7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-5bf280bb-8c7f-4d27-9a5e-2d5341164c11 req-4efd396d-cd65-4dad-b7ab-1c5ec75d53c7 service nova] Creating event network-vif-plugged:eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-5bf280bb-8c7f-4d27-9a5e-2d5341164c11 req-4efd396d-cd65-4dad-b7ab-1c5ec75d53c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045951 Nov 27 01:47:23 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 71/211] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:24 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-45b37de1-5194-4175-9458-21bdad558d74 req-87dacd3d-25e6-46ee-83c6-bc1aa7e0f0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "tag": "25b7419f-d628-4926-b706-f066c254e9b1"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-45b37de1-5194-4175-9458-21bdad558d74 req-87dacd3d-25e6-46ee-83c6-bc1aa7e0f0f9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-45b37de1-5194-4175-9458-21bdad558d74 req-87dacd3d-25e6-46ee-83c6-bc1aa7e0f0f9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-45b37de1-5194-4175-9458-21bdad558d74 req-87dacd3d-25e6-46ee-83c6-bc1aa7e0f0f9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-45b37de1-5194-4175-9458-21bdad558d74 req-87dacd3d-25e6-46ee-83c6-bc1aa7e0f0f9 service nova] Creating event network-changed:25b7419f-d628-4926-b706-f066c254e9b1 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-45b37de1-5194-4175-9458-21bdad558d74 req-87dacd3d-25e6-46ee-83c6-bc1aa7e0f0f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034634 Nov 27 01:47:24 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 72/212] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:24 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-cd1f97ca-2535-4995-bc57-7312b8a919b9 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92" status: 200 len: 2819 microversion: 2.42 time: 0.220434 Nov 27 01:47:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 70/213] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:47:24 2023] GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 => generated 2819 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-97f13975-6f71-42e7-8eea-83e25e2c4ad2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.409783 Nov 27 01:47:25 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 72/214] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Nov 27 01:47:25 2023] GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92/os-interface => generated 1830 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-115c3525-e345-485c-8b14-31cca15ae150 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Nov 27 01:47:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 73/215] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:47:25 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c0646ed5-9a45-418c-b3df-eb9ae5a0c8bd tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Nov 27 01:47:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 71/216] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:47:25 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] [instance: 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] [instance: 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:47:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8cdbf394-1d19-406b-be8d-587ce8d00f6b tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68" status: 204 len: 0 microversion: 2.1 time: 0.125165 Nov 27 01:47:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 74/217] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:47:25 2023] DELETE /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] [instance: 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:26 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lazy-loading 'services' on Instance uuid 32b8c121-240d-46f2-9e10-fdfb14753018 {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:47:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-841506c3-770f-4993-a009-74bf3557eb33 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments/8df37566-8a7e-402b-b5a9-5e734240fde6" status: 202 len: 0 microversion: 2.1 time: 0.332838 Nov 27 01:47:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:47:25 2023] DELETE /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments/8df37566-8a7e-402b-b5a9-5e734240fde6 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:47:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:26 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:26 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a974479967c4720817ccac8161d3fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94532ed6cedd4a158f8f3a9099c6c76c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-25476079-e670-4c57-8b38-206003a2214c tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68" status: 200 len: 1457 microversion: 2.1 time: 0.220389 Nov 27 01:47:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 72/219] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:47:26 2023] GET /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 => generated 1457 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-54cab5c6-5e0f-41a7-843e-5984b30e6a75 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056939 Nov 27 01:47:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 75/220] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:47:26 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-21250bf7-bc4c-4336-9f71-48cf5aa88c69 req-2a04bd8b-2659-4516-afde-cf613cbb2085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15dd9d3a-8c28-45c7-9fa2-bfee97b58e68", "name": "network-vif-unplugged", "status": "completed", "tag": "8201dd6b-3457-4b64-bee5-ac914d578700"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-21250bf7-bc4c-4336-9f71-48cf5aa88c69 req-2a04bd8b-2659-4516-afde-cf613cbb2085 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-21250bf7-bc4c-4336-9f71-48cf5aa88c69 req-2a04bd8b-2659-4516-afde-cf613cbb2085 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-21250bf7-bc4c-4336-9f71-48cf5aa88c69 req-2a04bd8b-2659-4516-afde-cf613cbb2085 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-21250bf7-bc4c-4336-9f71-48cf5aa88c69 req-2a04bd8b-2659-4516-afde-cf613cbb2085 service nova] Creating event network-vif-unplugged:8201dd6b-3457-4b64-bee5-ac914d578700 for instance 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 on user Nov 27 01:47:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-21250bf7-bc4c-4336-9f71-48cf5aa88c69 req-2a04bd8b-2659-4516-afde-cf613cbb2085 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032958 Nov 27 01:47:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 74/221] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:27 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:47:27 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-292c9bc3-a9dd-4342-8ee1-ccc1cb06d2d3 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92" status: 204 len: 0 microversion: 2.42 time: 0.170218 Nov 27 01:47:27 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 73/222] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:47:27 2023] DELETE /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:27 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d52b9eb758a480aaf7c1f6f4b985177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5047346f5a41599b86602ad3538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-1fecbe7c-78db-4b49-86ea-38b323b8657e tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92" status: 200 len: 2943 microversion: 2.42 time: 0.231047 Nov 27 01:47:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 76/223] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:47:27 2023] GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 => generated 2943 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:47:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6f8d590e-8b91-4cda-8cb2-f8c5b3d64133 req-bd12ddad-2a08-4dba-b7d8-39e7a136a2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-unplugged", "status": "completed", "tag": "b594e43e-af6b-49cd-92e0-12147106071d"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f8d590e-8b91-4cda-8cb2-f8c5b3d64133 req-bd12ddad-2a08-4dba-b7d8-39e7a136a2e9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f8d590e-8b91-4cda-8cb2-f8c5b3d64133 req-bd12ddad-2a08-4dba-b7d8-39e7a136a2e9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f8d590e-8b91-4cda-8cb2-f8c5b3d64133 req-bd12ddad-2a08-4dba-b7d8-39e7a136a2e9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6f8d590e-8b91-4cda-8cb2-f8c5b3d64133 req-bd12ddad-2a08-4dba-b7d8-39e7a136a2e9 service nova] Creating event network-vif-unplugged:b594e43e-af6b-49cd-92e0-12147106071d for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6f8d590e-8b91-4cda-8cb2-f8c5b3d64133 req-bd12ddad-2a08-4dba-b7d8-39e7a136a2e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049468 Nov 27 01:47:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 75/224] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-c736ab07-ab04-4ead-bab1-4c9fc7de98b8 req-c7d2a33e-520f-4953-b2d3-beed3dbfd6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-unplugged", "status": "completed", "tag": "7baee745-ba20-4859-9515-7a7e8632f1a6"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c736ab07-ab04-4ead-bab1-4c9fc7de98b8 req-c7d2a33e-520f-4953-b2d3-beed3dbfd6f5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c736ab07-ab04-4ead-bab1-4c9fc7de98b8 req-c7d2a33e-520f-4953-b2d3-beed3dbfd6f5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c736ab07-ab04-4ead-bab1-4c9fc7de98b8 req-c7d2a33e-520f-4953-b2d3-beed3dbfd6f5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-c736ab07-ab04-4ead-bab1-4c9fc7de98b8 req-c7d2a33e-520f-4953-b2d3-beed3dbfd6f5 service nova] Creating event network-vif-unplugged:7baee745-ba20-4859-9515-7a7e8632f1a6 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-c736ab07-ab04-4ead-bab1-4c9fc7de98b8 req-c7d2a33e-520f-4953-b2d3-beed3dbfd6f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066378 Nov 27 01:47:28 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 74/225] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:28 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15dd9d3a-8c28-45c7-9fa2-bfee97b58e68", "name": "network-vif-plugged", "status": "completed", "tag": "8201dd6b-3457-4b64-bee5-ac914d578700"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-deleted", "tag": "03f1300a-8159-45e6-9e84-0987d6d4b3a7"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-unplugged", "status": "completed", "tag": "25b7419f-d628-4926-b706-f066c254e9b1"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-deleted", "tag": "56b01b62-5838-42d0-b238-f09531c57a0c"}, {"server_uuid": "15dd9d3a-8c28-45c7-9fa2-bfee97b58e68", "name": "network-vif-deleted", "tag": "8201dd6b-3457-4b64-bee5-ac914d578700"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "25b7419f-d628-4926-b706-f066c254e9b1"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-deleted", "tag": "c700bd0a-6895-435d-a4c8-baba0bec47f7"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-unplugged", "status": "completed", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Creating event network-vif-plugged:8201dd6b-3457-4b64-bee5-ac914d578700 for instance 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 on user Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Creating event network-vif-deleted:03f1300a-8159-45e6-9e84-0987d6d4b3a7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Creating event network-vif-unplugged:25b7419f-d628-4926-b706-f066c254e9b1 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Creating event network-vif-deleted:56b01b62-5838-42d0-b238-f09531c57a0c for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Creating event network-vif-deleted:8201dd6b-3457-4b64-bee5-ac914d578700 for instance 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 on user Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Creating event network-vif-plugged:25b7419f-d628-4926-b706-f066c254e9b1 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Creating event network-vif-deleted:c700bd0a-6895-435d-a4c8-baba0bec47f7 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] Creating event network-vif-unplugged:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-59d5ae36-9097-40de-8f14-04a9c4694467 req-8891d383-8ae4-4f98-aecb-401a01745548 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1384 microversion: 2.1 time: 0.256125 Nov 27 01:47:29 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 77/226] 10.0.0.210 () {68 vars in 1395 bytes} [Mon Nov 27 01:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 1384 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:29 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:29 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:29 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3087faaf-fa30-49b9-bd98-617845c994a8 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-interface/90c7abb2-8b81-4847-b632-6403dc3ff8ae" status: 202 len: 0 microversion: 2.49 time: 0.101622 Nov 27 01:47:29 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 76/227] 10.0.0.210 () {64 vars in 1507 bytes} [Mon Nov 27 01:47:29 2023] DELETE /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-interface/90c7abb2-8b81-4847-b632-6403dc3ff8ae => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 27 01:47:29 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:29 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-cf029e5d-9a67-4600-bd41-288a02189345 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-instance-actions/req-3087faaf-fa30-49b9-bd98-617845c994a8" status: 200 len: 474 microversion: 2.49 time: 0.289420 Nov 27 01:47:29 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 75/228] 10.0.0.210 () {64 vars in 1537 bytes} [Mon Nov 27 01:47:29 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-instance-actions/req-3087faaf-fa30-49b9-bd98-617845c994a8 => generated 474 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:47:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-9da4f639-b564-429b-82f6-43cd56a9b013 req-e0911b3e-236e-4ef5-aafd-c5c26715d765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "b594e43e-af6b-49cd-92e0-12147106071d"}, {"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-unplugged", "status": "completed", "tag": "90c7abb2-8b81-4847-b632-6403dc3ff8ae"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9da4f639-b564-429b-82f6-43cd56a9b013 req-e0911b3e-236e-4ef5-aafd-c5c26715d765 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9da4f639-b564-429b-82f6-43cd56a9b013 req-e0911b3e-236e-4ef5-aafd-c5c26715d765 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9da4f639-b564-429b-82f6-43cd56a9b013 req-e0911b3e-236e-4ef5-aafd-c5c26715d765 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-9da4f639-b564-429b-82f6-43cd56a9b013 req-e0911b3e-236e-4ef5-aafd-c5c26715d765 service nova] Creating event network-vif-plugged:b594e43e-af6b-49cd-92e0-12147106071d for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-9da4f639-b564-429b-82f6-43cd56a9b013 req-e0911b3e-236e-4ef5-aafd-c5c26715d765 service nova] Creating event network-vif-unplugged:90c7abb2-8b81-4847-b632-6403dc3ff8ae for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:47:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-9da4f639-b564-429b-82f6-43cd56a9b013 req-e0911b3e-236e-4ef5-aafd-c5c26715d765 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037659 Nov 27 01:47:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 78/229] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:30 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-d1ea21c2-3b74-4e15-9c76-ba864492ae04 req-0e4c9571-c6b0-410f-9ecd-3dc57ccd4ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "7baee745-ba20-4859-9515-7a7e8632f1a6"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d1ea21c2-3b74-4e15-9c76-ba864492ae04 req-0e4c9571-c6b0-410f-9ecd-3dc57ccd4ab4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d1ea21c2-3b74-4e15-9c76-ba864492ae04 req-0e4c9571-c6b0-410f-9ecd-3dc57ccd4ab4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d1ea21c2-3b74-4e15-9c76-ba864492ae04 req-0e4c9571-c6b0-410f-9ecd-3dc57ccd4ab4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:30 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-d1ea21c2-3b74-4e15-9c76-ba864492ae04 req-0e4c9571-c6b0-410f-9ecd-3dc57ccd4ab4 service nova] Creating event network-vif-plugged:7baee745-ba20-4859-9515-7a7e8632f1a6 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:30 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-d1ea21c2-3b74-4e15-9c76-ba864492ae04 req-0e4c9571-c6b0-410f-9ecd-3dc57ccd4ab4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028719 Nov 27 01:47:30 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 77/230] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-unplugged", "status": "completed", "tag": "1ec02ad7-a7a8-4602-942a-b66c57a56b0e"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-deleted", "tag": "eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "1ec02ad7-a7a8-4602-942a-b66c57a56b0e"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-unplugged", "status": "completed", "tag": "0d99dd83-0e0d-4052-a410-d50b9102db65"}, {"server_uuid": "27bd4add-a93d-4979-83ee-623db8afa54c", "name": "network-vif-deleted", "tag": "5c48a087-d5b6-49ca-8842-9f9901638031"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "0d99dd83-0e0d-4052-a410-d50b9102db65"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-unplugged", "status": "completed", "tag": "58a0b7b7-ca5d-4889-9462-f3181c37db01"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "58a0b7b7-ca5d-4889-9462-f3181c37db01"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-plugged:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-unplugged:1ec02ad7-a7a8-4602-942a-b66c57a56b0e for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-deleted:eec4bb91-4aa8-4b47-8c5a-6d94abbc88bf for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-plugged:1ec02ad7-a7a8-4602-942a-b66c57a56b0e for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-unplugged:0d99dd83-0e0d-4052-a410-d50b9102db65 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-deleted:5c48a087-d5b6-49ca-8842-9f9901638031 for instance 27bd4add-a93d-4979-83ee-623db8afa54c on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-plugged:0d99dd83-0e0d-4052-a410-d50b9102db65 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-unplugged:58a0b7b7-ca5d-4889-9462-f3181c37db01 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-plugged:58a0b7b7-ca5d-4889-9462-f3181c37db01 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] Creating event network-vif-plugged:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-7390f38e-2d57-4486-b279-e6809c421676 req-bf2d90f0-75dd-4a1d-a0e6-b77ace95a959 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1728 microversion: 2.1 time: 0.048243 Nov 27 01:47:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 76/231] 10.0.0.210 () {68 vars in 1395 bytes} [Mon Nov 27 01:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 1728 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d73e8af6-e83d-4b6c-9cba-b7d43578d7bc req-b373259a-b977-445f-9bf4-dbac91058c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-plugged", "status": "completed", "tag": "90c7abb2-8b81-4847-b632-6403dc3ff8ae"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d73e8af6-e83d-4b6c-9cba-b7d43578d7bc req-b373259a-b977-445f-9bf4-dbac91058c32 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d73e8af6-e83d-4b6c-9cba-b7d43578d7bc req-b373259a-b977-445f-9bf4-dbac91058c32 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d73e8af6-e83d-4b6c-9cba-b7d43578d7bc req-b373259a-b977-445f-9bf4-dbac91058c32 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d73e8af6-e83d-4b6c-9cba-b7d43578d7bc req-b373259a-b977-445f-9bf4-dbac91058c32 service nova] Creating event network-vif-plugged:90c7abb2-8b81-4847-b632-6403dc3ff8ae for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:47:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d73e8af6-e83d-4b6c-9cba-b7d43578d7bc req-b373259a-b977-445f-9bf4-dbac91058c32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028257 Nov 27 01:47:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 79/232] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-122843c4-fab7-499b-9f49-036b1c5cb047 req-81a58618-1c0e-4995-9a9d-4bcf1592ed60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-unplugged", "status": "completed", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-plugged", "status": "completed", "tag": "d1f14c4b-b1e9-48b0-aba9-e384b3d751a2"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-122843c4-fab7-499b-9f49-036b1c5cb047 req-81a58618-1c0e-4995-9a9d-4bcf1592ed60 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-122843c4-fab7-499b-9f49-036b1c5cb047 req-81a58618-1c0e-4995-9a9d-4bcf1592ed60 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-122843c4-fab7-499b-9f49-036b1c5cb047 req-81a58618-1c0e-4995-9a9d-4bcf1592ed60 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-122843c4-fab7-499b-9f49-036b1c5cb047 req-81a58618-1c0e-4995-9a9d-4bcf1592ed60 service nova] Creating event network-vif-plugged:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-122843c4-fab7-499b-9f49-036b1c5cb047 req-81a58618-1c0e-4995-9a9d-4bcf1592ed60 service nova] Creating event network-vif-unplugged:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-122843c4-fab7-499b-9f49-036b1c5cb047 req-81a58618-1c0e-4995-9a9d-4bcf1592ed60 service nova] Creating event network-vif-plugged:d1f14c4b-b1e9-48b0-aba9-e384b3d751a2 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-122843c4-fab7-499b-9f49-036b1c5cb047 req-81a58618-1c0e-4995-9a9d-4bcf1592ed60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.030785 Nov 27 01:47:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:33 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-deleted", "tag": "7baee745-ba20-4859-9515-7a7e8632f1a6"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-deleted", "tag": "0d99dd83-0e0d-4052-a410-d50b9102db65"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-deleted", "tag": "58a0b7b7-ca5d-4889-9462-f3181c37db01"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-deleted", "tag": "25b7419f-d628-4926-b706-f066c254e9b1"}, {"server_uuid": "5aff6318-0f7f-4341-8ac3-6eeeba1e1c92", "name": "network-vif-deleted", "tag": "b594e43e-af6b-49cd-92e0-12147106071d"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Creating event network-vif-deleted:7baee745-ba20-4859-9515-7a7e8632f1a6 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Creating event network-vif-deleted:0d99dd83-0e0d-4052-a410-d50b9102db65 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Creating event network-vif-deleted:58a0b7b7-ca5d-4889-9462-f3181c37db01 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Creating event network-vif-deleted:25b7419f-d628-4926-b706-f066c254e9b1 for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] Creating event network-vif-deleted:b594e43e-af6b-49cd-92e0-12147106071d for instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 on user Nov 27 01:47:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-9233ffcc-a044-406a-bc50-6261b64cdfe1 req-0fb442d8-d3d3-49b4-8c58-ff3e529d2ab0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.042799 Nov 27 01:47:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:35 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=148,nova_cell1:UPDATE=8,nova_cell1:INSERT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-770616de-c2fb-47fb-8bf2-d1f92756758c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046892 Nov 27 01:47:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 80/235] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:47:42 2023] GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1533989355", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "5d7054e2-7c4f-40be-9c26-f95e092bda0b"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=45 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] validate_networks() for [('5d7054e2-7c4f-40be-9c26-f95e092bda0b', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Getting quotas for project 6ddad7e6dfb9484aa6a5a842430d6ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Getting quotas for user b460cf65f2b44e42bf5e8297989b0fe9 and project 6ddad7e6dfb9484aa6a5a842430d6ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:47:43 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: bb3d759e-37a5-45d5-a154-35616a647899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:47:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-814dd1b1-1586-4f99-8618-bc762501b2bf tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.633225 Nov 27 01:47:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 79/236] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:47:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:47:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-81c142d8-0487-4ab5-92e7-5003a0ac6858 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-81c142d8-0487-4ab5-92e7-5003a0ac6858 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: bb3d759e-37a5-45d5-a154-35616a647899] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:43 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:43 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-81c142d8-0487-4ab5-92e7-5003a0ac6858 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b460cf65f2b44e42bf5e8297989b0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddad7e6dfb9484aa6a5a842430d6ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:47:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-81c142d8-0487-4ab5-92e7-5003a0ac6858 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899" status: 200 len: 1210 microversion: 2.1 time: 0.065714 Nov 27 01:47:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 78/237] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:47:43 2023] GET /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899 => generated 1210 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:47:46 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-82cf9693-5aaa-41df-ad73-c7002be6d627 req-b3e3e641-3bbb-4580-9e58-9261e3c6615d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb3d759e-37a5-45d5-a154-35616a647899", "tag": "60a8e89e-afb2-4e58-9c1f-180d307a0a6e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-82cf9693-5aaa-41df-ad73-c7002be6d627 req-b3e3e641-3bbb-4580-9e58-9261e3c6615d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-82cf9693-5aaa-41df-ad73-c7002be6d627 req-b3e3e641-3bbb-4580-9e58-9261e3c6615d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-82cf9693-5aaa-41df-ad73-c7002be6d627 req-b3e3e641-3bbb-4580-9e58-9261e3c6615d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-82cf9693-5aaa-41df-ad73-c7002be6d627 req-b3e3e641-3bbb-4580-9e58-9261e3c6615d service nova] Creating event network-changed:60a8e89e-afb2-4e58-9c1f-180d307a0a6e for instance bb3d759e-37a5-45d5-a154-35616a647899 on user Nov 27 01:47:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-82cf9693-5aaa-41df-ad73-c7002be6d627 req-b3e3e641-3bbb-4580-9e58-9261e3c6615d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031223 Nov 27 01:47:46 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 81/238] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-9a2949a7-656e-4383-a233-2f12fabba4cf req-042034e3-94a9-4767-a2a6-77ca52e47188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3d759e-37a5-45d5-a154-35616a647899", "name": "network-vif-plugged", "status": "completed", "tag": "60a8e89e-afb2-4e58-9c1f-180d307a0a6e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9a2949a7-656e-4383-a233-2f12fabba4cf req-042034e3-94a9-4767-a2a6-77ca52e47188 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9a2949a7-656e-4383-a233-2f12fabba4cf req-042034e3-94a9-4767-a2a6-77ca52e47188 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9a2949a7-656e-4383-a233-2f12fabba4cf req-042034e3-94a9-4767-a2a6-77ca52e47188 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-9a2949a7-656e-4383-a233-2f12fabba4cf req-042034e3-94a9-4767-a2a6-77ca52e47188 service nova] Creating event network-vif-plugged:60a8e89e-afb2-4e58-9c1f-180d307a0a6e for instance bb3d759e-37a5-45d5-a154-35616a647899 on user Nov 27 01:47:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-9a2949a7-656e-4383-a233-2f12fabba4cf req-042034e3-94a9-4767-a2a6-77ca52e47188 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Nov 27 01:47:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 80/239] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-76d75976-2227-4094-a769-a00730d7d5c8 req-f6755a6b-6a6b-4896-bfc1-6bf215da8eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-deleted", "tag": "90c7abb2-8b81-4847-b632-6403dc3ff8ae"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:50 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=129,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-76d75976-2227-4094-a769-a00730d7d5c8 req-f6755a6b-6a6b-4896-bfc1-6bf215da8eaf service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-76d75976-2227-4094-a769-a00730d7d5c8 req-f6755a6b-6a6b-4896-bfc1-6bf215da8eaf service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-76d75976-2227-4094-a769-a00730d7d5c8 req-f6755a6b-6a6b-4896-bfc1-6bf215da8eaf service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-76d75976-2227-4094-a769-a00730d7d5c8 req-f6755a6b-6a6b-4896-bfc1-6bf215da8eaf service nova] Creating event network-vif-deleted:90c7abb2-8b81-4847-b632-6403dc3ff8ae for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:47:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-76d75976-2227-4094-a769-a00730d7d5c8 req-f6755a6b-6a6b-4896-bfc1-6bf215da8eaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034792 Nov 27 01:47:50 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 79/240] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:50 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-3e3925e7-fea3-44ea-9dbb-11f2d107a71d req-dd6e2310-c794-4d5a-bb83-6688e0cf5990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3d759e-37a5-45d5-a154-35616a647899", "name": "network-vif-plugged", "status": "completed", "tag": "60a8e89e-afb2-4e58-9c1f-180d307a0a6e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:47:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3e3925e7-fea3-44ea-9dbb-11f2d107a71d req-dd6e2310-c794-4d5a-bb83-6688e0cf5990 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3e3925e7-fea3-44ea-9dbb-11f2d107a71d req-dd6e2310-c794-4d5a-bb83-6688e0cf5990 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3e3925e7-fea3-44ea-9dbb-11f2d107a71d req-dd6e2310-c794-4d5a-bb83-6688e0cf5990 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-3e3925e7-fea3-44ea-9dbb-11f2d107a71d req-dd6e2310-c794-4d5a-bb83-6688e0cf5990 service nova] Creating event network-vif-plugged:60a8e89e-afb2-4e58-9c1f-180d307a0a6e for instance bb3d759e-37a5-45d5-a154-35616a647899 on user Nov 27 01:47:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-3e3925e7-fea3-44ea-9dbb-11f2d107a71d req-dd6e2310-c794-4d5a-bb83-6688e0cf5990 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033870 Nov 27 01:47:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 82/241] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:47:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:47:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:47:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-65083997-f948-4ec5-b859-83b336690f06 tempest-VolumesAssistedSnapshotsTest-1365302808 tempest-VolumesAssistedSnapshotsTest-1365302808-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084564 Nov 27 01:47:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:47:58 2023] GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:00 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:48:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ed04919a-20e3-4d86-8d88-ff70d0d097a1 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53" status: 204 len: 0 microversion: 2.1 time: 0.138592 Nov 27 01:48:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 80/243] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:48:00 2023] DELETE /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=10 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:00 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-31fa7c75-16c1-4e29-845b-bd466b4c3df9 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53" status: 200 len: 1498 microversion: 2.1 time: 0.248632 Nov 27 01:48:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 83/244] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:00 2023] GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53 => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-3f39c3e7-9051-4196-96f6-46ab46a8e5d9 req-6aac2ab5-56e5-4985-b2ed-b6752ec0e40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98831619-1f75-41ad-a5f8-52a3f9055d53", "name": "network-vif-unplugged", "status": "completed", "tag": "0533611c-db34-46d1-92d0-6eeab5f1ddc1"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3f39c3e7-9051-4196-96f6-46ab46a8e5d9 req-6aac2ab5-56e5-4985-b2ed-b6752ec0e40e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3f39c3e7-9051-4196-96f6-46ab46a8e5d9 req-6aac2ab5-56e5-4985-b2ed-b6752ec0e40e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3f39c3e7-9051-4196-96f6-46ab46a8e5d9 req-6aac2ab5-56e5-4985-b2ed-b6752ec0e40e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-3f39c3e7-9051-4196-96f6-46ab46a8e5d9 req-6aac2ab5-56e5-4985-b2ed-b6752ec0e40e service nova] Creating event network-vif-unplugged:0533611c-db34-46d1-92d0-6eeab5f1ddc1 for instance 98831619-1f75-41ad-a5f8-52a3f9055d53 on user Nov 27 01:48:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-3f39c3e7-9051-4196-96f6-46ab46a8e5d9 req-6aac2ab5-56e5-4985-b2ed-b6752ec0e40e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028892 Nov 27 01:48:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 82/245] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:48:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-04fcfc81-e6bc-484c-9731-31bc4d525de3 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad" status: 204 len: 0 microversion: 2.1 time: 0.103631 Nov 27 01:48:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 81/246] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:48:02 2023] DELETE /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:02 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-5a0580b1-4243-4bab-8036-c4da547887ce req-948dff20-cb36-4c56-9a5c-496a8d4c5bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3ea204-3973-4a37-924b-b09cd19b7fad", "name": "network-vif-unplugged", "status": "completed", "tag": "5c0af32c-d4a0-475d-8ed8-89c716bc2925"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:02 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20be68cb2665439facd51e94febfead1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bedf4fb8224abbae3e881366c6ddb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5a0580b1-4243-4bab-8036-c4da547887ce req-948dff20-cb36-4c56-9a5c-496a8d4c5bce service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5a0580b1-4243-4bab-8036-c4da547887ce req-948dff20-cb36-4c56-9a5c-496a8d4c5bce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5a0580b1-4243-4bab-8036-c4da547887ce req-948dff20-cb36-4c56-9a5c-496a8d4c5bce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-336af1fe-25f7-436e-a5fe-07bf74845fa4 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad" status: 200 len: 1676 microversion: 2.1 time: 0.338877 Nov 27 01:48:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 84/247] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:02 2023] GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad => generated 1676 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-5a0580b1-4243-4bab-8036-c4da547887ce req-948dff20-cb36-4c56-9a5c-496a8d4c5bce service nova] Creating event network-vif-unplugged:5c0af32c-d4a0-475d-8ed8-89c716bc2925 for instance eb3ea204-3973-4a37-924b-b09cd19b7fad on user Nov 27 01:48:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-5a0580b1-4243-4bab-8036-c4da547887ce req-948dff20-cb36-4c56-9a5c-496a8d4c5bce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041697 Nov 27 01:48:02 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-399eb728-52b9-462f-9db6-3c9d2845f28d req-5c308fe0-3727-4caa-b2ac-9bc324da07b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98831619-1f75-41ad-a5f8-52a3f9055d53", "name": "network-vif-plugged", "status": "completed", "tag": "0533611c-db34-46d1-92d0-6eeab5f1ddc1"}, {"server_uuid": "98831619-1f75-41ad-a5f8-52a3f9055d53", "name": "network-vif-deleted", "tag": "0533611c-db34-46d1-92d0-6eeab5f1ddc1"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-399eb728-52b9-462f-9db6-3c9d2845f28d req-5c308fe0-3727-4caa-b2ac-9bc324da07b3 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-399eb728-52b9-462f-9db6-3c9d2845f28d req-5c308fe0-3727-4caa-b2ac-9bc324da07b3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-399eb728-52b9-462f-9db6-3c9d2845f28d req-5c308fe0-3727-4caa-b2ac-9bc324da07b3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-399eb728-52b9-462f-9db6-3c9d2845f28d req-5c308fe0-3727-4caa-b2ac-9bc324da07b3 service nova] Creating event network-vif-plugged:0533611c-db34-46d1-92d0-6eeab5f1ddc1 for instance 98831619-1f75-41ad-a5f8-52a3f9055d53 on user Nov 27 01:48:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-399eb728-52b9-462f-9db6-3c9d2845f28d req-5c308fe0-3727-4caa-b2ac-9bc324da07b3 service nova] Creating event network-vif-deleted:0533611c-db34-46d1-92d0-6eeab5f1ddc1 for instance 98831619-1f75-41ad-a5f8-52a3f9055d53 on user Nov 27 01:48:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-399eb728-52b9-462f-9db6-3c9d2845f28d req-5c308fe0-3727-4caa-b2ac-9bc324da07b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033254 Nov 27 01:48:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 82/249] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:04 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-a6189bba-91cf-432a-b84b-6ff76e0ac566 req-b9441f07-c7ae-4120-bbeb-cea041988cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3ea204-3973-4a37-924b-b09cd19b7fad", "name": "network-vif-plugged", "status": "completed", "tag": "5c0af32c-d4a0-475d-8ed8-89c716bc2925"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a6189bba-91cf-432a-b84b-6ff76e0ac566 req-b9441f07-c7ae-4120-bbeb-cea041988cc7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a6189bba-91cf-432a-b84b-6ff76e0ac566 req-b9441f07-c7ae-4120-bbeb-cea041988cc7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a6189bba-91cf-432a-b84b-6ff76e0ac566 req-b9441f07-c7ae-4120-bbeb-cea041988cc7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-a6189bba-91cf-432a-b84b-6ff76e0ac566 req-b9441f07-c7ae-4120-bbeb-cea041988cc7 service nova] Creating event network-vif-plugged:5c0af32c-d4a0-475d-8ed8-89c716bc2925 for instance eb3ea204-3973-4a37-924b-b09cd19b7fad on user Nov 27 01:48:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-a6189bba-91cf-432a-b84b-6ff76e0ac566 req-b9441f07-c7ae-4120-bbeb-cea041988cc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039231 Nov 27 01:48:04 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 85/250] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:04 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-d06d89f4-9baa-4b1f-b8ef-82da0890854a req-24908194-9449-4ab3-8f56-85b209527fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3ea204-3973-4a37-924b-b09cd19b7fad", "name": "network-vif-deleted", "tag": "5c0af32c-d4a0-475d-8ed8-89c716bc2925"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d06d89f4-9baa-4b1f-b8ef-82da0890854a req-24908194-9449-4ab3-8f56-85b209527fc7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d06d89f4-9baa-4b1f-b8ef-82da0890854a req-24908194-9449-4ab3-8f56-85b209527fc7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d06d89f4-9baa-4b1f-b8ef-82da0890854a req-24908194-9449-4ab3-8f56-85b209527fc7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:04 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-d06d89f4-9baa-4b1f-b8ef-82da0890854a req-24908194-9449-4ab3-8f56-85b209527fc7 service nova] Creating event network-vif-deleted:5c0af32c-d4a0-475d-8ed8-89c716bc2925 for instance eb3ea204-3973-4a37-924b-b09cd19b7fad on user Nov 27 01:48:04 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-d06d89f4-9baa-4b1f-b8ef-82da0890854a req-24908194-9449-4ab3-8f56-85b209527fc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028834 Nov 27 01:48:04 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 84/251] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6c2e7c46-60b1-428b-985f-e8da799bd89c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'create', calling method: .version_select at 0x7f364b69d000>, body: {"keypair": {"name": "tempest-keypair-1762372762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEP+Wr/yQ4ai+TB2gJ2/yBjdUob1cq8Vcq1mJa8j97ZlB+pYmE6kOTzTxVDMjfWdbapmTag7KppV7wMRb3k6nKbmlXvXHpckHUgpDEQIDJMYaq49LE1oMzDX5MktZSdk2A=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:05 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-6c2e7c46-60b1-428b-985f-e8da799bd89c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:48:05 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-6c2e7c46-60b1-428b-985f-e8da799bd89c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for user 4d1d312ea9224e4b9e57e5576276a485 and project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:48:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6c2e7c46-60b1-428b-985f-e8da799bd89c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057231 Nov 27 01:48:05 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 83/252] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:48:05 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:06 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:06 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d9e17743-5d5e-401b-9c90-8bd0f048072a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 200 len: 1501 microversion: 2.1 time: 0.214349 Nov 27 01:48:06 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 86/253] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:06 2023] GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50e56f15-9bea-4b1c-aba8-938b46953d4d"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-911193610", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "02938945-a111-40c2-94ba-4203299781f0"}], "security_groups": [{"name": "tempest-securitygroup--1173538862"}], "key_name": "tempest-keypair-1762372762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c7833cc9-2e16-42d3-aaf1-ad9834f36550 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294768 Nov 27 01:48:07 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 85/254] 10.0.0.210 () {66 vars in 1441 bytes} [Mon Nov 27 01:48:07 2023] POST /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] validate_networks() for [('02938945-a111-40c2-94ba-4203299781f0', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65194) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 27 01:48:07 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c525c94f-f4b9-4deb-b06e-9b4e7a1398fb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/action" status: 202 len: 0 microversion: 2.20 time: 0.109410 Nov 27 01:48:07 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 87/255] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 01:48:07 2023] POST /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:07 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b278e7f5-07d4-426f-90d1-9dd0b451e11d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 200 len: 1737 microversion: 2.20 time: 0.282372 Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:07 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 86/256] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:48:07 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for user 4d1d312ea9224e4b9e57e5576276a485 and project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:48:07 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:48:07 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-80f3fe0c-97f6-439d-aa33-f0d36b0a2656 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.603300 Nov 27 01:48:07 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 84/257] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:48:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8466a28a-effd-4b60-8331-2ec65d41af62 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:07 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8466a28a-effd-4b60-8331-2ec65d41af62 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:08 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-8466a28a-effd-4b60-8331-2ec65d41af62 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8466a28a-effd-4b60-8331-2ec65d41af62 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 200 len: 1233 microversion: 2.1 time: 0.087610 Nov 27 01:48:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 88/258] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:07 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:10 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] HTTP exception thrown: Instance 27bd4add-a93d-4979-83ee-623db8afa54c could not be found. Nov 27 01:48:10 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Returning 404 to user: Instance 27bd4add-a93d-4979-83ee-623db8afa54c could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:10 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-6d66fa39-125c-4dd9-8097-85570c7747ba tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c" status: 404 len: 111 microversion: 2.32 time: 0.072690 Nov 27 01:48:10 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:48:10 2023] GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:10 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7a6c5c6a-c61c-4cc2-8a0a-da8703e0266d tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '.version_select at 0x7f364b4bfac0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-226aa55c-747d-44bb-a603-dfe497d4be1c req-eceb0c6d-7fe9-49ea-b0d4-2fcd57e33545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-226aa55c-747d-44bb-a603-dfe497d4be1c req-eceb0c6d-7fe9-49ea-b0d4-2fcd57e33545 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-226aa55c-747d-44bb-a603-dfe497d4be1c req-eceb0c6d-7fe9-49ea-b0d4-2fcd57e33545 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-226aa55c-747d-44bb-a603-dfe497d4be1c req-eceb0c6d-7fe9-49ea-b0d4-2fcd57e33545 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-226aa55c-747d-44bb-a603-dfe497d4be1c req-eceb0c6d-7fe9-49ea-b0d4-2fcd57e33545 service nova] Creating event network-changed:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:48:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-226aa55c-747d-44bb-a603-dfe497d4be1c req-eceb0c6d-7fe9-49ea-b0d4-2fcd57e33545 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027831 Nov 27 01:48:10 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 89/260] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7a6c5c6a-c61c-4cc2-8a0a-da8703e0266d tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496479439" status: 204 len: 0 microversion: 2.32 time: 0.200382 Nov 27 01:48:10 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 85/261] 10.0.0.210 () {64 vars in 1339 bytes} [Mon Nov 27 01:48:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496479439 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:12 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-09db6aa6-0b6b-4af3-8e08-807d896fcd90 req-1fcc439b-4655-4792-9294-191fe7afa225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-plugged", "status": "completed", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-09db6aa6-0b6b-4af3-8e08-807d896fcd90 req-1fcc439b-4655-4792-9294-191fe7afa225 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-09db6aa6-0b6b-4af3-8e08-807d896fcd90 req-1fcc439b-4655-4792-9294-191fe7afa225 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-09db6aa6-0b6b-4af3-8e08-807d896fcd90 req-1fcc439b-4655-4792-9294-191fe7afa225 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:12 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990555ee1c2a4bfa9858705701a49079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954c903a669a46feadbf6b78531c6639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-09db6aa6-0b6b-4af3-8e08-807d896fcd90 req-1fcc439b-4655-4792-9294-191fe7afa225 service nova] Creating event network-vif-plugged:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:48:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-09db6aa6-0b6b-4af3-8e08-807d896fcd90 req-1fcc439b-4655-4792-9294-191fe7afa225 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034824 Nov 27 01:48:12 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 90/262] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-98980713-5532-4882-ade6-d8d81a712b96 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 200 len: 1669 microversion: 2.1 time: 0.255322 Nov 27 01:48:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 88/263] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:12 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 1669 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f87fb7b-d3b4-480d-a5f8-a65737a984d9"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:12 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-b3336418-6e35-44e6-8dda-d98a4db7295d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "POST /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373135 Nov 27 01:48:13 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 86/264] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:48:12 2023] POST /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] HTTP exception thrown: Instance 27bd4add-a93d-4979-83ee-623db8afa54c could not be found. Nov 27 01:48:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Returning 404 to user: Instance 27bd4add-a93d-4979-83ee-623db8afa54c could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-bfc4e4c4-7cb7-4e59-ab1d-a7687461f799 tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c" status: 404 len: 111 microversion: 2.32 time: 0.027806 Nov 27 01:48:14 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 91/265] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:48:14 2023] DELETE /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] [instance: 27bd4add-a93d-4979-83ee-623db8afa54c] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:14 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] HTTP exception thrown: Instance 27bd4add-a93d-4979-83ee-623db8afa54c could not be found. Nov 27 01:48:14 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] Returning 404 to user: Instance 27bd4add-a93d-4979-83ee-623db8afa54c could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:14 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-22baa327-3160-4f03-b995-a1cc83a1d53a tempest-TaggedBootDevicesTest-277738494 tempest-TaggedBootDevicesTest-277738494-project-member] 10.0.0.210 "GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c" status: 404 len: 111 microversion: 2.32 time: 0.028764 Nov 27 01:48:14 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 89/266] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:48:14 2023] GET /compute/v2.1/servers/27bd4add-a93d-4979-83ee-623db8afa54c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:14 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-80a48ce2-301f-46c2-9379-b7cafbbac08a req-807c1de1-b2b8-4c4e-b817-af82582bb8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-plugged", "status": "completed", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-80a48ce2-301f-46c2-9379-b7cafbbac08a req-807c1de1-b2b8-4c4e-b817-af82582bb8cb service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-80a48ce2-301f-46c2-9379-b7cafbbac08a req-807c1de1-b2b8-4c4e-b817-af82582bb8cb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-80a48ce2-301f-46c2-9379-b7cafbbac08a req-807c1de1-b2b8-4c4e-b817-af82582bb8cb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-80a48ce2-301f-46c2-9379-b7cafbbac08a req-807c1de1-b2b8-4c4e-b817-af82582bb8cb service nova] Creating event network-vif-plugged:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:48:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-80a48ce2-301f-46c2-9379-b7cafbbac08a req-807c1de1-b2b8-4c4e-b817-af82582bb8cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046314 Nov 27 01:48:15 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 87/267] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] [instance: 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:16 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:16 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:16 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] HTTP exception thrown: Instance 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 could not be found. Nov 27 01:48:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] Returning 404 to user: Instance 15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:16 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-7b532246-50c8-4598-818b-81a603ff7eec tempest-VolumesNegativeTest-1107828387 tempest-VolumesNegativeTest-1107828387-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68" status: 404 len: 111 microversion: 2.1 time: 0.034082 Nov 27 01:48:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:16 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 92/268] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:16 2023] GET /compute/v2.1/servers/15dd9d3a-8c28-45c7-9fa2-bfee97b58e68 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:48:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9e189918-8499-4a16-9d99-5ffe660eeb86 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054227 Nov 27 01:48:16 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 90/269] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:48:16 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:16 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:48:16 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-b0a8e70e-e624-4f86-a1b3-5ab65ed7e261 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018" status: 204 len: 0 microversion: 2.1 time: 0.153311 Nov 27 01:48:16 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 88/270] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:48:16 2023] DELETE /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:16 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88cdd664583049a08aa80789741e373e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de2f7796550460380f122aa6ad7cfb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:16 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-61896eee-48bd-4e6c-ae2a-8b6dc25fa12f tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018" status: 200 len: 1648 microversion: 2.1 time: 0.237974 Nov 27 01:48:16 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 93/271] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:16 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018 => generated 1648 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-deed81f6-3bc4-4878-9439-148f47a2f711 req-fe2dd6d5-3eb5-4621-9413-d4def854e4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b8c121-240d-46f2-9e10-fdfb14753018", "name": "network-vif-unplugged", "status": "completed", "tag": "f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-deed81f6-3bc4-4878-9439-148f47a2f711 req-fe2dd6d5-3eb5-4621-9413-d4def854e4e5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-deed81f6-3bc4-4878-9439-148f47a2f711 req-fe2dd6d5-3eb5-4621-9413-d4def854e4e5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-deed81f6-3bc4-4878-9439-148f47a2f711 req-fe2dd6d5-3eb5-4621-9413-d4def854e4e5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-deed81f6-3bc4-4878-9439-148f47a2f711 req-fe2dd6d5-3eb5-4621-9413-d4def854e4e5 service nova] Creating event network-vif-unplugged:f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa for instance 32b8c121-240d-46f2-9e10-fdfb14753018 on user Nov 27 01:48:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-deed81f6-3bc4-4878-9439-148f47a2f711 req-fe2dd6d5-3eb5-4621-9413-d4def854e4e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029774 Nov 27 01:48:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] HTTP exception thrown: Instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 could not be found. Nov 27 01:48:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Returning 404 to user: Instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-8ee7cc7f-3176-4290-ac78-e0bb083103e2 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92" status: 404 len: 111 microversion: 2.42 time: 0.074142 Nov 27 01:48:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 89/273] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:48:17 2023] GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:17 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d9907110-f880-4fdc-b7b9-819a635c4c97 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '.version_select at 0x7f364b5c95a0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:17 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d9907110-f880-4fdc-b7b9-819a635c4c97 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390478396" status: 204 len: 0 microversion: 2.42 time: 0.029093 Nov 27 01:48:17 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 94/274] 10.0.0.210 () {64 vars in 1336 bytes} [Mon Nov 27 01:48:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390478396 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 27 01:48:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-632ffd23-f9d5-4087-972b-bf67dbd0d05c req-bf911397-9412-4a46-8220-be4a47886e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}, {"server_uuid": "32b8c121-240d-46f2-9e10-fdfb14753018", "name": "network-vif-plugged", "status": "completed", "tag": "f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa"}, {"server_uuid": "32b8c121-240d-46f2-9e10-fdfb14753018", "name": "network-vif-deleted", "tag": "f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-632ffd23-f9d5-4087-972b-bf67dbd0d05c req-bf911397-9412-4a46-8220-be4a47886e91 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-632ffd23-f9d5-4087-972b-bf67dbd0d05c req-bf911397-9412-4a46-8220-be4a47886e91 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-632ffd23-f9d5-4087-972b-bf67dbd0d05c req-bf911397-9412-4a46-8220-be4a47886e91 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-632ffd23-f9d5-4087-972b-bf67dbd0d05c req-bf911397-9412-4a46-8220-be4a47886e91 service nova] Creating event network-changed:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:48:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-632ffd23-f9d5-4087-972b-bf67dbd0d05c req-bf911397-9412-4a46-8220-be4a47886e91 service nova] Creating event network-vif-plugged:f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa for instance 32b8c121-240d-46f2-9e10-fdfb14753018 on user Nov 27 01:48:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-632ffd23-f9d5-4087-972b-bf67dbd0d05c req-bf911397-9412-4a46-8220-be4a47886e91 service nova] Creating event network-vif-deleted:f1dc5c1c-acb4-4a33-8ce7-f5ee2ab604aa for instance 32b8c121-240d-46f2-9e10-fdfb14753018 on user Nov 27 01:48:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-632ffd23-f9d5-4087-972b-bf67dbd0d05c req-bf911397-9412-4a46-8220-be4a47886e91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.043221 Nov 27 01:48:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 92/275] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:19 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=10 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-226e03b3-c8b9-487f-820b-13c99c16b879 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-instance-actions/req-3087faaf-fa30-49b9-bd98-617845c994a8" status: 200 len: 503 microversion: 2.49 time: 0.094201 Nov 27 01:48:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 90/276] 10.0.0.210 () {64 vars in 1537 bytes} [Mon Nov 27 01:48:19 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-instance-actions/req-3087faaf-fa30-49b9-bd98-617845c994a8 => generated 503 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-155b9377-2867-4eeb-966f-61380215cac7 tempest-TaggedAttachmentsTest-482591892 tempest-TaggedAttachmentsTest-482591892-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-instance-actions/req-3087faaf-fa30-49b9-bd98-617845c994a8" status: 200 len: 503 microversion: 2.49 time: 0.119834 Nov 27 01:48:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 95/277] 10.0.0.210 () {64 vars in 1537 bytes} [Mon Nov 27 01:48:19 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-instance-actions/req-3087faaf-fa30-49b9-bd98-617845c994a8 => generated 503 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b12f2045-4cad-46b5-a947-6f0553df8b06 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.147105 Nov 27 01:48:20 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 93/278] 10.0.0.210 () {64 vars in 1420 bytes} [Mon Nov 27 01:48:20 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:20 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:48:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d4e9c68b-7f6b-4682-bcce-ee22e41512e7 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab" status: 204 len: 0 microversion: 2.49 time: 0.187920 Nov 27 01:48:20 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 91/279] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:48:20 2023] DELETE /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 01:48:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:20 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:20 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6f6d9925-c173-432a-9af0-a7226e85b312 req-43267068-9b06-45dc-871f-e8db9287e6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-unplugged", "status": "completed", "tag": "e8111c75-793e-4e5b-9d85-f3ea893a780e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:21 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:21 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:21 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2e87e21090a42ca8b3c46eac21763de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228828e9e60146beb7be4fad823bfb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-1cac73ab-8b54-4568-93a7-30f4946fa7a9 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab" status: 200 len: 1750 microversion: 2.49 time: 0.559062 Nov 27 01:48:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 96/280] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:48:20 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab => generated 1750 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 01:48:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f6d9925-c173-432a-9af0-a7226e85b312 req-43267068-9b06-45dc-871f-e8db9287e6e5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f6d9925-c173-432a-9af0-a7226e85b312 req-43267068-9b06-45dc-871f-e8db9287e6e5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f6d9925-c173-432a-9af0-a7226e85b312 req-43267068-9b06-45dc-871f-e8db9287e6e5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6f6d9925-c173-432a-9af0-a7226e85b312 req-43267068-9b06-45dc-871f-e8db9287e6e5 service nova] Creating event network-vif-unplugged:e8111c75-793e-4e5b-9d85-f3ea893a780e for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:48:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6f6d9925-c173-432a-9af0-a7226e85b312 req-43267068-9b06-45dc-871f-e8db9287e6e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062184 Nov 27 01:48:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 94/281] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] HTTP exception thrown: Instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 could not be found. Nov 27 01:48:22 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Returning 404 to user: Instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6f3fa116-b56d-4206-a15d-0a35454ca13f tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92" status: 404 len: 111 microversion: 2.42 time: 0.063470 Nov 27 01:48:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 92/282] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:48:22 2023] DELETE /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] [instance: 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] HTTP exception thrown: Instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 could not be found. Nov 27 01:48:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] Returning 404 to user: Instance 5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4e42f4fd-8f61-47ec-bdc7-3b624271ede7 tempest-TaggedBootDevicesTest_v242-1753373528 tempest-TaggedBootDevicesTest_v242-1753373528-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92" status: 404 len: 111 microversion: 2.42 time: 0.077898 Nov 27 01:48:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 97/283] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:48:22 2023] GET /compute/v2.1/servers/5aff6318-0f7f-4341-8ac3-6eeeba1e1c92 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-cb01fc3b-6476-474a-9c33-278f24331905 req-deccf71f-e3b2-48ae-b0df-9fe0f424f16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-deleted", "tag": "e8111c75-793e-4e5b-9d85-f3ea893a780e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-cb01fc3b-6476-474a-9c33-278f24331905 req-deccf71f-e3b2-48ae-b0df-9fe0f424f16c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-cb01fc3b-6476-474a-9c33-278f24331905 req-deccf71f-e3b2-48ae-b0df-9fe0f424f16c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-cb01fc3b-6476-474a-9c33-278f24331905 req-deccf71f-e3b2-48ae-b0df-9fe0f424f16c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-cb01fc3b-6476-474a-9c33-278f24331905 req-deccf71f-e3b2-48ae-b0df-9fe0f424f16c service nova] Creating event network-vif-deleted:e8111c75-793e-4e5b-9d85-f3ea893a780e for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:48:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-cb01fc3b-6476-474a-9c33-278f24331905 req-deccf71f-e3b2-48ae-b0df-9fe0f424f16c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071087 Nov 27 01:48:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 95/284] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:23 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-51873284-79ff-4992-aba5-7a82a4754522 req-2ac3549d-3edf-45b1-ac92-7b1c70801a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f94cb8-8808-4426-b97b-b337932e49ab", "name": "network-vif-plugged", "status": "completed", "tag": "e8111c75-793e-4e5b-9d85-f3ea893a780e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-51873284-79ff-4992-aba5-7a82a4754522 req-2ac3549d-3edf-45b1-ac92-7b1c70801a7e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-51873284-79ff-4992-aba5-7a82a4754522 req-2ac3549d-3edf-45b1-ac92-7b1c70801a7e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-51873284-79ff-4992-aba5-7a82a4754522 req-2ac3549d-3edf-45b1-ac92-7b1c70801a7e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-51873284-79ff-4992-aba5-7a82a4754522 req-2ac3549d-3edf-45b1-ac92-7b1c70801a7e service nova] Creating event network-vif-plugged:e8111c75-793e-4e5b-9d85-f3ea893a780e for instance 21f94cb8-8808-4426-b97b-b337932e49ab on user Nov 27 01:48:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-51873284-79ff-4992-aba5-7a82a4754522 req-2ac3549d-3edf-45b1-ac92-7b1c70801a7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126275 Nov 27 01:48:23 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 93/285] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "67d9107c-79bc-4e26-bdb3-5cb69980ffb0"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:24 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lazy-loading 'flavor' on Instance uuid 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:48:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4f852e0b-829c-40a2-9643-19446c9e3a7a tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "POST /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/action" status: 200 len: 29 microversion: 2.1 time: 0.418754 Nov 27 01:48:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 98/286] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:48:24 2023] POST /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/action => generated 29 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:25 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990555ee1c2a4bfa9858705701a49079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954c903a669a46feadbf6b78531c6639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:25 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e267d184-55c8-496f-8467-5cc3ba50197d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 200 len: 1721 microversion: 2.1 time: 0.382076 Nov 27 01:48:25 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 96/287] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:25 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-2bdb2bde-115e-4f8e-99ef-1b92d8975ec8 req-4150f055-7022-4b9e-b852-52f155be4bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-unplugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2bdb2bde-115e-4f8e-99ef-1b92d8975ec8 req-4150f055-7022-4b9e-b852-52f155be4bf3 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2bdb2bde-115e-4f8e-99ef-1b92d8975ec8 req-4150f055-7022-4b9e-b852-52f155be4bf3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2bdb2bde-115e-4f8e-99ef-1b92d8975ec8 req-4150f055-7022-4b9e-b852-52f155be4bf3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-2bdb2bde-115e-4f8e-99ef-1b92d8975ec8 req-4150f055-7022-4b9e-b852-52f155be4bf3 service nova] Creating event network-vif-unplugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:48:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-2bdb2bde-115e-4f8e-99ef-1b92d8975ec8 req-4150f055-7022-4b9e-b852-52f155be4bf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035565 Nov 27 01:48:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 94/288] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:28 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-6b7d4b70-bd34-4511-b163-76b7fac779c5 req-386b0a6f-0202-481e-9c19-20cd81e6eb74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6b7d4b70-bd34-4511-b163-76b7fac779c5 req-386b0a6f-0202-481e-9c19-20cd81e6eb74 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6b7d4b70-bd34-4511-b163-76b7fac779c5 req-386b0a6f-0202-481e-9c19-20cd81e6eb74 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6b7d4b70-bd34-4511-b163-76b7fac779c5 req-386b0a6f-0202-481e-9c19-20cd81e6eb74 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:28 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6b7d4b70-bd34-4511-b163-76b7fac779c5 req-386b0a6f-0202-481e-9c19-20cd81e6eb74 service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:48:28 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-6b7d4b70-bd34-4511-b163-76b7fac779c5 req-386b0a6f-0202-481e-9c19-20cd81e6eb74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036364 Nov 27 01:48:28 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 99/289] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:48:30 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-c11763bd-dd47-41f8-9b0f-a6d3c877365c req-8e6009f7-a10f-4bdb-aad6-b9028d104774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-plugged", "status": "completed", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c11763bd-dd47-41f8-9b0f-a6d3c877365c req-8e6009f7-a10f-4bdb-aad6-b9028d104774 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c11763bd-dd47-41f8-9b0f-a6d3c877365c req-8e6009f7-a10f-4bdb-aad6-b9028d104774 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c11763bd-dd47-41f8-9b0f-a6d3c877365c req-8e6009f7-a10f-4bdb-aad6-b9028d104774 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:30 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c11763bd-dd47-41f8-9b0f-a6d3c877365c req-8e6009f7-a10f-4bdb-aad6-b9028d104774 service nova] Creating event network-vif-plugged:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:48:30 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-c11763bd-dd47-41f8-9b0f-a6d3c877365c req-8e6009f7-a10f-4bdb-aad6-b9028d104774 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048595 Nov 27 01:48:30 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 97/290] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:32 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-1338e9de-ca4a-423f-8a97-a1664db59201 req-5c68caaa-4d29-4cb5-a426-42bb4b6bb2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-plugged", "status": "completed", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1338e9de-ca4a-423f-8a97-a1664db59201 req-5c68caaa-4d29-4cb5-a426-42bb4b6bb2df service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1338e9de-ca4a-423f-8a97-a1664db59201 req-5c68caaa-4d29-4cb5-a426-42bb4b6bb2df service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1338e9de-ca4a-423f-8a97-a1664db59201 req-5c68caaa-4d29-4cb5-a426-42bb4b6bb2df service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-1338e9de-ca4a-423f-8a97-a1664db59201 req-5c68caaa-4d29-4cb5-a426-42bb4b6bb2df service nova] Creating event network-vif-plugged:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:48:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-1338e9de-ca4a-423f-8a97-a1664db59201 req-5c68caaa-4d29-4cb5-a426-42bb4b6bb2df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030397 Nov 27 01:48:32 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 95/291] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-8ba93a0d-9377-45ce-93d4-eebaf396ac8a req-7c486867-136d-4818-a69d-76fe366d987b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8ba93a0d-9377-45ce-93d4-eebaf396ac8a req-7c486867-136d-4818-a69d-76fe366d987b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8ba93a0d-9377-45ce-93d4-eebaf396ac8a req-7c486867-136d-4818-a69d-76fe366d987b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8ba93a0d-9377-45ce-93d4-eebaf396ac8a req-7c486867-136d-4818-a69d-76fe366d987b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-8ba93a0d-9377-45ce-93d4-eebaf396ac8a req-7c486867-136d-4818-a69d-76fe366d987b service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:48:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-8ba93a0d-9377-45ce-93d4-eebaf396ac8a req-7c486867-136d-4818-a69d-76fe366d987b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056213 Nov 27 01:48:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 100/292] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:33 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: bb3d759e-37a5-45d5-a154-35616a647899] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:34 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b460cf65f2b44e42bf5e8297989b0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddad7e6dfb9484aa6a5a842430d6ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b0518b70-9119-4549-ae54-fd86c6bef87e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899" status: 200 len: 1494 microversion: 2.1 time: 0.349988 Nov 27 01:48:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 98/293] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:33 2023] GET /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899 => generated 1494 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-365a3913-ef89-411e-be31-701b32b0e990 req-3ceedc75-bb8a-41d2-8d16-252af8ace441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-365a3913-ef89-411e-be31-701b32b0e990 req-3ceedc75-bb8a-41d2-8d16-252af8ace441 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-365a3913-ef89-411e-be31-701b32b0e990 req-3ceedc75-bb8a-41d2-8d16-252af8ace441 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-365a3913-ef89-411e-be31-701b32b0e990 req-3ceedc75-bb8a-41d2-8d16-252af8ace441 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-365a3913-ef89-411e-be31-701b32b0e990 req-3ceedc75-bb8a-41d2-8d16-252af8ace441 service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:48:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-365a3913-ef89-411e-be31-701b32b0e990 req-3ceedc75-bb8a-41d2-8d16-252af8ace441 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047232 Nov 27 01:48:34 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 96/294] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a344f233-855b-48bf-86c1-55638b62ffac tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Action: 'create', calling method: .version_select at 0x7f364b3bc310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1362219063", "metadata": {"Type": "work"}}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a344f233-855b-48bf-86c1-55638b62ffac tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a344f233-855b-48bf-86c1-55638b62ffac tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.199752 Nov 27 01:48:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 101/295] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Nov 27 01:48:43 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7696e9ea-281d-482d-b142-a74efe4151e0 tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Action: 'create', calling method: .version_select at 0x7f364b6a2f80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1559900832", "metadata": {"Type": "work"}}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7696e9ea-281d-482d-b142-a74efe4151e0 tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7696e9ea-281d-482d-b142-a74efe4151e0 tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008086 Nov 27 01:48:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 99/296] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Nov 27 01:48:43 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4678f1f5-72a7-45de-b266-af50f77925f8 tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Action: 'create', calling method: .version_select at 0x7f364b4bfeb0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-588494154", "metadata": {"Type": "work"}}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4678f1f5-72a7-45de-b266-af50f77925f8 tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4678f1f5-72a7-45de-b266-af50f77925f8 tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017655 Nov 27 01:48:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 97/297] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Nov 27 01:48:43 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:48:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f71f3509-4ec6-4446-ba71-9fd86f272b2f tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Calling method '.version_select at 0x7f364b893250>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-f71f3509-4ec6-4446-ba71-9fd86f272b2f tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] HTTP exception thrown: Volume tempest-invalid-1334185760 could not be found. Nov 27 01:48:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f71f3509-4ec6-4446-ba71-9fd86f272b2f tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Returning 404 to user: Volume tempest-invalid-1334185760 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-f71f3509-4ec6-4446-ba71-9fd86f272b2f tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1334185760" status: 404 len: 99 microversion: 2.1 time: 0.058823 Nov 27 01:48:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 102/298] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 01:48:43 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1334185760 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 27 01:48:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4f8d0114-07f0-47bd-8171-830c8453edd6 tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003819 Nov 27 01:48:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 100/299] 10.0.0.210 () {62 vars in 1217 bytes} [Mon Nov 27 01:48:43 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 27 01:48:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-238088cf-e548-4faf-89a3-1d07c38ca806 tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004555 Nov 27 01:48:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 98/300] 10.0.0.210 () {62 vars in 1214 bytes} [Mon Nov 27 01:48:43 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 27 01:48:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2a796f98-f583-478c-80c6-924ebc8a0c2c tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Calling method '.version_select at 0x7f364b3bc3a0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-2a796f98-f583-478c-80c6-924ebc8a0c2c tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] HTTP exception thrown: Volume f93fc44d-9b9e-4eb4-8afe-eeff106f8ebd could not be found. Nov 27 01:48:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2a796f98-f583-478c-80c6-924ebc8a0c2c tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Returning 404 to user: Volume f93fc44d-9b9e-4eb4-8afe-eeff106f8ebd could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2a796f98-f583-478c-80c6-924ebc8a0c2c tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/f93fc44d-9b9e-4eb4-8afe-eeff106f8ebd" status: 404 len: 109 microversion: 2.1 time: 0.046213 Nov 27 01:48:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 103/301] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 01:48:43 2023] DELETE /compute/v2.1/os-volumes/f93fc44d-9b9e-4eb4-8afe-eeff106f8ebd => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:48:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-52d2c23c-6628-421c-9915-245f412f462f tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Calling method '.version_select at 0x7f364b65f520>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-52d2c23c-6628-421c-9915-245f412f462f tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] HTTP exception thrown: Volume e993c90e-a8e4-40c2-891f-e22af201f267 could not be found. Nov 27 01:48:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-52d2c23c-6628-421c-9915-245f412f462f tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] Returning 404 to user: Volume e993c90e-a8e4-40c2-891f-e22af201f267 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-52d2c23c-6628-421c-9915-245f412f462f tempest-VolumesNegativeTest-277693024 tempest-VolumesNegativeTest-277693024-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e993c90e-a8e4-40c2-891f-e22af201f267" status: 404 len: 109 microversion: 2.1 time: 0.088100 Nov 27 01:48:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 101/302] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 01:48:43 2023] GET /compute/v2.1/os-volumes/e993c90e-a8e4-40c2-891f-e22af201f267 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:48:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=4,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=10,nova_cell1:INSERT=5 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-08bdff8b-4378-4d24-8b7c-7d3e7afbd153 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Action: 'create', calling method: .version_select at 0x7f364b69c940>, body: {"keypair": {"name": "tempest-keypair-342771245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp4GGB+v0TaJJgwz9CPVmIdpQh+iN2gLtJeX0C5Woqccalglk/oS0cjIYDgbaGa9Y+IGai82+CAMOrrHNsCH69Z1rbbw4EzfF+EclYykYoC8UwsqG68kPn3DsQ25XlruQ=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:45 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-08bdff8b-4378-4d24-8b7c-7d3e7afbd153 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Getting quotas for project ed38a15ada7a48a9b490cfef0cc09f8f. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:48:45 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-08bdff8b-4378-4d24-8b7c-7d3e7afbd153 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Getting quotas for user 61091e519f55480db63568e194c5b3e0 and project ed38a15ada7a48a9b490cfef0cc09f8f. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:48:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-08bdff8b-4378-4d24-8b7c-7d3e7afbd153 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175460 Nov 27 01:48:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 99/303] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:48:45 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:47 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachScenarioOldVersion-server-1891632910", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "21884204-6b6d-487b-a8cc-44a4af3b86b3"}], "security_groups": [{"name": "tempest-securitygroup--1896801881"}], "key_name": "tempest-keypair-342771245", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] validate_networks() for [('21884204-6b6d-487b-a8cc-44a4af3b86b3', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Getting quotas for project ed38a15ada7a48a9b490cfef0cc09f8f. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Getting quotas for user 61091e519f55480db63568e194c5b3e0 and project ed38a15ada7a48a9b490cfef0cc09f8f. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:48:48 user devstack@n-api.service[65194]: WARNING nova.utils [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Hostname tempest-TestServerVolumeAttachScenarioOldVersion-server-1891632910 is longer than 63, truncate it to tempest-TestServerVolumeAttachScenarioOldVersion-server-1891632 Nov 27 01:48:48 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:48:48 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a34a1e9d-3560-4928-9371-4aa1919636e5 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.786951 Nov 27 01:48:48 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 104/304] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:48:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:48:48 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=36 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:48 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:48:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-dedb9cbc-c3c3-44b4-8aea-667d311604b6 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:48 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-dedb9cbc-c3c3-44b4-8aea-667d311604b6 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:48 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-dedb9cbc-c3c3-44b4-8aea-667d311604b6 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61091e519f55480db63568e194c5b3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed38a15ada7a48a9b490cfef0cc09f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-dedb9cbc-c3c3-44b4-8aea-667d311604b6 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee" status: 200 len: 1249 microversion: 2.1 time: 0.084719 Nov 27 01:48:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 102/305] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:48 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] HTTP exception thrown: Instance 98831619-1f75-41ad-a5f8-52a3f9055d53 could not be found. Nov 27 01:48:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Returning 404 to user: Instance 98831619-1f75-41ad-a5f8-52a3f9055d53 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-534798ec-1bf4-48fe-b08a-93242d75af79 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53" status: 404 len: 111 microversion: 2.1 time: 0.026932 Nov 27 01:48:50 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 100/306] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:50 2023] GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:50 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-920d6583-1a77-4e55-8464-ff89ef136316 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 200 len: 1492 microversion: 2.1 time: 0.202944 Nov 27 01:48:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 105/307] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:50 2023] GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 1492 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:48:52 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-0d4aa54a-5685-4410-8102-af9869d5c169 req-930ff83a-092f-415d-9a4a-f1e403d73d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d4aa54a-5685-4410-8102-af9869d5c169 req-930ff83a-092f-415d-9a4a-f1e403d73d5c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d4aa54a-5685-4410-8102-af9869d5c169 req-930ff83a-092f-415d-9a4a-f1e403d73d5c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d4aa54a-5685-4410-8102-af9869d5c169 req-930ff83a-092f-415d-9a4a-f1e403d73d5c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-0d4aa54a-5685-4410-8102-af9869d5c169 req-930ff83a-092f-415d-9a4a-f1e403d73d5c service nova] Creating event network-changed:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:48:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-0d4aa54a-5685-4410-8102-af9869d5c169 req-930ff83a-092f-415d-9a4a-f1e403d73d5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065332 Nov 27 01:48:52 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 103/308] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] [instance: eb3ea204-3973-4a37-924b-b09cd19b7fad] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] HTTP exception thrown: Instance eb3ea204-3973-4a37-924b-b09cd19b7fad could not be found. Nov 27 01:48:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Returning 404 to user: Instance eb3ea204-3973-4a37-924b-b09cd19b7fad could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:48:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-94a27d70-7886-46f4-9ae6-beafd7a39dcc tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad" status: 404 len: 111 microversion: 2.1 time: 0.028679 Nov 27 01:48:52 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 101/309] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:52 2023] GET /compute/v2.1/servers/eb3ea204-3973-4a37-924b-b09cd19b7fad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:48:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-32456226-cbb5-46c0-bc47-165eb8ca9444 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] Calling method '.version_select at 0x7f364b4e79a0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-32456226-cbb5-46c0-bc47-165eb8ca9444 tempest-VolumesAssistedSnapshotsTest-219277321 tempest-VolumesAssistedSnapshotsTest-219277321-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510332191" status: 202 len: 0 microversion: 2.1 time: 0.035891 Nov 27 01:48:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 106/310] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 01:48:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510332191 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:48:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-575343177", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "0674729f-c03e-4bfb-bfbe-32ac4c167bcf"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] validate_networks() for [('0674729f-c03e-4bfb-bfbe-32ac4c167bcf', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Getting quotas for project b168d75a030e425886b18204a7173843. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Getting quotas for user 357d7d579c284bcd836dd8075476d5ed and project b168d75a030e425886b18204a7173843. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:48:54 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:48:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-848bbc26-1335-402f-aa34-d6f54ec0c6fb tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.032405 Nov 27 01:48:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 104/311] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Nov 27 01:48:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:48:54 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-bc8583ad-65ac-43f8-a6ef-855384701493 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:54 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-bc8583ad-65ac-43f8-a6ef-855384701493 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:54 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-bc8583ad-65ac-43f8-a6ef-855384701493 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:54 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-bc8583ad-65ac-43f8-a6ef-855384701493 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:54 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-bc8583ad-65ac-43f8-a6ef-855384701493 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-bc8583ad-65ac-43f8-a6ef-855384701493 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291" status: 200 len: 1394 microversion: 2.87 time: 0.096822 Nov 27 01:48:54 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 102/312] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:48:54 2023] GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291 => generated 1394 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:48:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:57 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-9704351e-06a9-42e4-8873-9f30f5a2a520 req-1f74c99d-adf5-4306-8330-fddecc1830e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9704351e-06a9-42e4-8873-9f30f5a2a520 req-1f74c99d-adf5-4306-8330-fddecc1830e4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9704351e-06a9-42e4-8873-9f30f5a2a520 req-1f74c99d-adf5-4306-8330-fddecc1830e4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9704351e-06a9-42e4-8873-9f30f5a2a520 req-1f74c99d-adf5-4306-8330-fddecc1830e4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-9704351e-06a9-42e4-8873-9f30f5a2a520 req-1f74c99d-adf5-4306-8330-fddecc1830e4 service nova] Creating event network-changed:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 01:48:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-9704351e-06a9-42e4-8873-9f30f5a2a520 req-1f74c99d-adf5-4306-8330-fddecc1830e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032166 Nov 27 01:48:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:58 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3627b2a3-2ecf-4f29-817d-690870810fc6 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 200 len: 1782 microversion: 2.20 time: 0.523295 Nov 27 01:48:58 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 107/314] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:48:57 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 1782 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 01:48:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-0496cab1-a4de-4334-adbe-da1e77186e4d req-c3d92f3c-43c2-4e3e-ba8b-639275f624b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-plugged", "status": "completed", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:48:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0496cab1-a4de-4334-adbe-da1e77186e4d req-c3d92f3c-43c2-4e3e-ba8b-639275f624b2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:48:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0496cab1-a4de-4334-adbe-da1e77186e4d req-c3d92f3c-43c2-4e3e-ba8b-639275f624b2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:48:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0496cab1-a4de-4334-adbe-da1e77186e4d req-c3d92f3c-43c2-4e3e-ba8b-639275f624b2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:48:58 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:48:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-0496cab1-a4de-4334-adbe-da1e77186e4d req-c3d92f3c-43c2-4e3e-ba8b-639275f624b2 service nova] Creating event network-vif-plugged:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:48:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-0496cab1-a4de-4334-adbe-da1e77186e4d req-c3d92f3c-43c2-4e3e-ba8b-639275f624b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065189 Nov 27 01:48:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 106/315] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:48:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:48:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a2730ea5-0387-44f7-b960-f81f9de445e1 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 200 len: 1542 microversion: 2.1 time: 0.600564 Nov 27 01:48:58 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 103/316] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:48:58 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 1542 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:49:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-ede6ff6d-395e-4c84-961e-d87951d34232 req-91f5e0e9-9200-44ef-8d2d-8b88d751ac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-plugged", "status": "completed", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}, {"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-plugged", "status": "completed", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}, {"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-plugged", "status": "completed", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:00 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:00 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ede6ff6d-395e-4c84-961e-d87951d34232 req-91f5e0e9-9200-44ef-8d2d-8b88d751ac0b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ede6ff6d-395e-4c84-961e-d87951d34232 req-91f5e0e9-9200-44ef-8d2d-8b88d751ac0b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ede6ff6d-395e-4c84-961e-d87951d34232 req-91f5e0e9-9200-44ef-8d2d-8b88d751ac0b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ede6ff6d-395e-4c84-961e-d87951d34232 req-91f5e0e9-9200-44ef-8d2d-8b88d751ac0b service nova] Creating event network-vif-plugged:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:49:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ede6ff6d-395e-4c84-961e-d87951d34232 req-91f5e0e9-9200-44ef-8d2d-8b88d751ac0b service nova] Creating event network-vif-plugged:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 01:49:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ede6ff6d-395e-4c84-961e-d87951d34232 req-91f5e0e9-9200-44ef-8d2d-8b88d751ac0b service nova] Creating event network-vif-plugged:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 01:49:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-ede6ff6d-395e-4c84-961e-d87951d34232 req-91f5e0e9-9200-44ef-8d2d-8b88d751ac0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051541 Nov 27 01:49:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 108/317] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:00 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] [instance: 32b8c121-240d-46f2-9e10-fdfb14753018] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] HTTP exception thrown: Instance 32b8c121-240d-46f2-9e10-fdfb14753018 could not be found. Nov 27 01:49:07 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Returning 404 to user: Instance 32b8c121-240d-46f2-9e10-fdfb14753018 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:49:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ec246e9a-3122-48d0-8e53-8d752ad3fac2 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018" status: 404 len: 111 microversion: 2.1 time: 0.036479 Nov 27 01:49:07 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 107/318] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:49:07 2023] GET /compute/v2.1/servers/32b8c121-240d-46f2-9e10-fdfb14753018 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:49:07 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-8394b4b8-3fc4-4313-94fe-3b69aba1c487 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] Calling method '.version_select at 0x7f364b393eb0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:07 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:07 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-8394b4b8-3fc4-4313-94fe-3b69aba1c487 tempest-TestVolumeSwap-364578060 tempest-TestVolumeSwap-364578060-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-72430363" status: 202 len: 0 microversion: 2.1 time: 0.027561 Nov 27 01:49:07 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 104/319] 10.0.0.210 () {62 vars in 1292 bytes} [Mon Nov 27 01:49:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-72430363 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:09 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lazy-loading 'flavor' on Instance uuid cd137692-54b9-481d-b758-b9f1a5e67b82 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:49:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0047ff5d-c053-4c9d-a649-642823dc72f1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82/action" status: 200 len: 32 microversion: 2.1 time: 0.223620 Nov 27 01:49:09 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 109/320] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:49:09 2023] POST /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:49:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:09 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:10 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:10 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7b2213e5-16c4-48e8-89fd-6a14cde41ec9 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 200 len: 1507 microversion: 2.1 time: 0.296307 Nov 27 01:49:10 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 108/321] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:49:09 2023] GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:49:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=10 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:10 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-084cb29c-b150-4518-9436-83d5791fb51e req-bc8ca376-10d7-42f0-bc33-9a2181e0b7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-unplugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-084cb29c-b150-4518-9436-83d5791fb51e req-bc8ca376-10d7-42f0-bc33-9a2181e0b7b8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-084cb29c-b150-4518-9436-83d5791fb51e req-bc8ca376-10d7-42f0-bc33-9a2181e0b7b8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-084cb29c-b150-4518-9436-83d5791fb51e req-bc8ca376-10d7-42f0-bc33-9a2181e0b7b8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-084cb29c-b150-4518-9436-83d5791fb51e req-bc8ca376-10d7-42f0-bc33-9a2181e0b7b8 service nova] Creating event network-vif-unplugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:49:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-084cb29c-b150-4518-9436-83d5791fb51e req-bc8ca376-10d7-42f0-bc33-9a2181e0b7b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044841 Nov 27 01:49:10 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 105/322] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] HTTP exception thrown: Instance 21f94cb8-8808-4426-b97b-b337932e49ab could not be found. Nov 27 01:49:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Returning 404 to user: Instance 21f94cb8-8808-4426-b97b-b337932e49ab could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:49:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-87d42e49-38e2-45d1-a630-2c56c41f7569 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab" status: 404 len: 111 microversion: 2.49 time: 0.044905 Nov 27 01:49:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 110/323] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:49:11 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:49:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-fe7ed3ce-e582-49f1-865f-fd4268ff3d33 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '.version_select at 0x7f364b451a20>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-fe7ed3ce-e582-49f1-865f-fd4268ff3d33 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055392276" status: 204 len: 0 microversion: 2.49 time: 0.035515 Nov 27 01:49:11 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 109/324] 10.0.0.210 () {64 vars in 1339 bytes} [Mon Nov 27 01:49:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055392276 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 27 01:49:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-f8c3239c-36c4-478d-a3d6-cd2982c2504d req-c7caa149-1fbe-49f7-96b0-b0ac8e384ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f8c3239c-36c4-478d-a3d6-cd2982c2504d req-c7caa149-1fbe-49f7-96b0-b0ac8e384ada service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f8c3239c-36c4-478d-a3d6-cd2982c2504d req-c7caa149-1fbe-49f7-96b0-b0ac8e384ada service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f8c3239c-36c4-478d-a3d6-cd2982c2504d req-c7caa149-1fbe-49f7-96b0-b0ac8e384ada service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-f8c3239c-36c4-478d-a3d6-cd2982c2504d req-c7caa149-1fbe-49f7-96b0-b0ac8e384ada service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:49:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-f8c3239c-36c4-478d-a3d6-cd2982c2504d req-c7caa149-1fbe-49f7-96b0-b0ac8e384ada service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065490 Nov 27 01:49:12 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 106/325] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:13 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] HTTP exception thrown: Instance 21f94cb8-8808-4426-b97b-b337932e49ab could not be found. Nov 27 01:49:13 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Returning 404 to user: Instance 21f94cb8-8808-4426-b97b-b337932e49ab could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:49:13 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5b6a3c8d-7b89-4ae9-9124-be3cd6df9735 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab" status: 404 len: 111 microversion: 2.49 time: 0.034610 Nov 27 01:49:13 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 111/326] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:49:13 2023] DELETE /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] [instance: 21f94cb8-8808-4426-b97b-b337932e49ab] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:13 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] HTTP exception thrown: Instance 21f94cb8-8808-4426-b97b-b337932e49ab could not be found. Nov 27 01:49:13 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] Returning 404 to user: Instance 21f94cb8-8808-4426-b97b-b337932e49ab could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:49:13 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7043b1e3-2a9c-481d-b58b-b130deb43ee3 tempest-TaggedAttachmentsTest-923412646 tempest-TaggedAttachmentsTest-923412646-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab" status: 404 len: 111 microversion: 2.49 time: 0.041612 Nov 27 01:49:13 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 110/327] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:49:13 2023] GET /compute/v2.1/servers/21f94cb8-8808-4426-b97b-b337932e49ab => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:49:14 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d8da41d5-aaba-4422-a6a8-7cc077ef6169 req-5da8118e-1476-4785-b353-6abc0decc303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}, {"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d8da41d5-aaba-4422-a6a8-7cc077ef6169 req-5da8118e-1476-4785-b353-6abc0decc303 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d8da41d5-aaba-4422-a6a8-7cc077ef6169 req-5da8118e-1476-4785-b353-6abc0decc303 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d8da41d5-aaba-4422-a6a8-7cc077ef6169 req-5da8118e-1476-4785-b353-6abc0decc303 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:14 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d8da41d5-aaba-4422-a6a8-7cc077ef6169 req-5da8118e-1476-4785-b353-6abc0decc303 service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:49:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d8da41d5-aaba-4422-a6a8-7cc077ef6169 req-5da8118e-1476-4785-b353-6abc0decc303 service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:49:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-d8da41d5-aaba-4422-a6a8-7cc077ef6169 req-5da8118e-1476-4785-b353-6abc0decc303 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062574 Nov 27 01:49:15 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 107/328] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:15 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990555ee1c2a4bfa9858705701a49079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954c903a669a46feadbf6b78531c6639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-80c444d3-9ab4-4c8c-888d-2e9a06ff37ca tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 200 len: 1701 microversion: 2.1 time: 0.282282 Nov 27 01:49:15 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 112/329] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:49:15 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 1701 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:49:27 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:27 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=18 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-887961f1-6efb-465b-8a05-158468663d06 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Action: 'create', calling method: .version_select at 0x7f364b453d00>, body: {"keypair": {"name": "tempest-keypair-1416531055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxR9TMppGYGpsLbgR2gCHhbhlEDjto6DS2XoCCG+GR9TTC5O2RgXjHQEA4ENBjILWET6SQAbVDbUdnKRgK36D79XuGoPRc0/NfXKHLGnUqsQFQv3UQrNE3WGJHYpJZAiw=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:28 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-887961f1-6efb-465b-8a05-158468663d06 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Getting quotas for project 5be6c26710e74c5388a4bde76dc6c43b. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:49:28 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-887961f1-6efb-465b-8a05-158468663d06 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Getting quotas for user e9f516a04e9548be9fdfde99560a2853 and project 5be6c26710e74c5388a4bde76dc6c43b. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:49:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-887961f1-6efb-465b-8a05-158468663d06 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.318514 Nov 27 01:49:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 111/330] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:49:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-386121272", "imageRef": "2543210f-6e0e-460e-a960-57417290dfb2", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "c526eaaa-891a-490f-94e1-aabd310783cc"}], "security_groups": [{"name": "tempest-securitygroup--1197155460"}], "key_name": "tempest-keypair-1416531055", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:30 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] validate_networks() for [('c526eaaa-891a-490f-94e1-aabd310783cc', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Getting quotas for project 5be6c26710e74c5388a4bde76dc6c43b. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Getting quotas for user e9f516a04e9548be9fdfde99560a2853 and project 5be6c26710e74c5388a4bde76dc6c43b. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:49:31 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2543210f-6e0e-460e-a960-57417290dfb2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:49:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-bd939056-02a0-41d4-a458-48348f6aece7 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.040471 Nov 27 01:49:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 108/331] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:49:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:49:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-fe5754f8-10e7-4256-991e-02d65c65a021 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:31 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-fe5754f8-10e7-4256-991e-02d65c65a021 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:31 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:31 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:31 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-fe5754f8-10e7-4256-991e-02d65c65a021 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f516a04e9548be9fdfde99560a2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6c26710e74c5388a4bde76dc6c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-fe5754f8-10e7-4256-991e-02d65c65a021 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4" status: 200 len: 1237 microversion: 2.1 time: 0.322500 Nov 27 01:49:31 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 113/332] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:49:31 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 => generated 1237 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:49:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-773db804-89bb-4ad5-bcdf-2185027d609b req-ac5cd5de-efc1-4a93-bc3c-7d1a223ddc6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fa0915-0bc4-4fb9-9e41-e14d51e993b4", "tag": "0e20ea14-2cac-46bc-849d-a97a3e033d3c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-773db804-89bb-4ad5-bcdf-2185027d609b req-ac5cd5de-efc1-4a93-bc3c-7d1a223ddc6f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-773db804-89bb-4ad5-bcdf-2185027d609b req-ac5cd5de-efc1-4a93-bc3c-7d1a223ddc6f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-773db804-89bb-4ad5-bcdf-2185027d609b req-ac5cd5de-efc1-4a93-bc3c-7d1a223ddc6f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-773db804-89bb-4ad5-bcdf-2185027d609b req-ac5cd5de-efc1-4a93-bc3c-7d1a223ddc6f service nova] Creating event network-changed:0e20ea14-2cac-46bc-849d-a97a3e033d3c for instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 on user Nov 27 01:49:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-773db804-89bb-4ad5-bcdf-2185027d609b req-ac5cd5de-efc1-4a93-bc3c-7d1a223ddc6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215132 Nov 27 01:49:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 112/333] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2007219069", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "a450b4e7-83b2-4f5b-b77e-213a87107ac0"}]}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:35 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] validate_networks() for [('a450b4e7-83b2-4f5b-b77e-213a87107ac0', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Getting quotas for project a7220ed7a6df4d2ca599344d306270a4. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Getting quotas for user 55c646987f224bff8087f028e03712d6 and project a7220ed7a6df4d2ca599344d306270a4. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:49:36 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:49:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-683712e3-d94d-42d6-a0f6-e346800520c2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.648992 Nov 27 01:49:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 109/334] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:49:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:49:36 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4432ce5c-7124-41f0-b0bc-669b29d64e24 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:36 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4432ce5c-7124-41f0-b0bc-669b29d64e24 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:36 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4432ce5c-7124-41f0-b0bc-669b29d64e24 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c646987f224bff8087f028e03712d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7220ed7a6df4d2ca599344d306270a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:36 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4432ce5c-7124-41f0-b0bc-669b29d64e24 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26" status: 200 len: 1207 microversion: 2.1 time: 0.082897 Nov 27 01:49:36 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 114/335] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:49:36 2023] GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26 => generated 1207 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:49:36 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c07e76d5-de09-4b14-9ed7-a8904881547b"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:36 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] [instance: bb3d759e-37a5-45d5-a154-35616a647899] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:37 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] HTTP exception thrown: Volume 0c6a5a4b-826f-445b-9ed7-1d4ffed35d42 could not be found. Nov 27 01:49:37 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] Returning 404 to user: Volume 0c6a5a4b-826f-445b-9ed7-1d4ffed35d42 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:49:37 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5b7497d8-b48b-445b-a021-196e14e6b306 tempest-VolumesAdminNegativeTest-382815837 tempest-VolumesAdminNegativeTest-382815837-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899/os-volume_attachments/0c6a5a4b-826f-445b-9ed7-1d4ffed35d42" status: 404 len: 109 microversion: 2.1 time: 0.368526 Nov 27 01:49:37 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 113/336] 10.0.0.210 () {64 vars in 1510 bytes} [Mon Nov 27 01:49:36 2023] PUT /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899/os-volume_attachments/0c6a5a4b-826f-445b-9ed7-1d4ffed35d42 => generated 109 bytes in 371 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:49:38 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d9ae97c2-c16f-4e8a-aae4-077daeec1ed7 req-aa9ed81e-5055-4d4c-bf91-634f7362366e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fa0915-0bc4-4fb9-9e41-e14d51e993b4", "name": "network-vif-plugged", "status": "completed", "tag": "0e20ea14-2cac-46bc-849d-a97a3e033d3c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d9ae97c2-c16f-4e8a-aae4-077daeec1ed7 req-aa9ed81e-5055-4d4c-bf91-634f7362366e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d9ae97c2-c16f-4e8a-aae4-077daeec1ed7 req-aa9ed81e-5055-4d4c-bf91-634f7362366e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d9ae97c2-c16f-4e8a-aae4-077daeec1ed7 req-aa9ed81e-5055-4d4c-bf91-634f7362366e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d9ae97c2-c16f-4e8a-aae4-077daeec1ed7 req-aa9ed81e-5055-4d4c-bf91-634f7362366e service nova] Creating event network-vif-plugged:0e20ea14-2cac-46bc-849d-a97a3e033d3c for instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 on user Nov 27 01:49:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-d9ae97c2-c16f-4e8a-aae4-077daeec1ed7 req-aa9ed81e-5055-4d4c-bf91-634f7362366e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299742 Nov 27 01:49:38 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 110/337] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:38 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:38 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:39 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61091e519f55480db63568e194c5b3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed38a15ada7a48a9b490cfef0cc09f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-87432a33-34f0-42de-bfad-0b50d341d1c4 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee" status: 200 len: 1575 microversion: 2.1 time: 0.275881 Nov 27 01:49:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 115/338] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:49:38 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee => generated 1575 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:49:39 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:39 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-e4e81422-cd46-444b-9ea5-051ad738a275 req-c0b3b4e2-df3e-4a25-a06d-addca8d13d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d94162-bb03-4c5c-98c7-0c5cfdb6de26", "tag": "9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e4e81422-cd46-444b-9ea5-051ad738a275 req-c0b3b4e2-df3e-4a25-a06d-addca8d13d43 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e4e81422-cd46-444b-9ea5-051ad738a275 req-c0b3b4e2-df3e-4a25-a06d-addca8d13d43 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e4e81422-cd46-444b-9ea5-051ad738a275 req-c0b3b4e2-df3e-4a25-a06d-addca8d13d43 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-e4e81422-cd46-444b-9ea5-051ad738a275 req-c0b3b4e2-df3e-4a25-a06d-addca8d13d43 service nova] Creating event network-changed:9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4 for instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 on user Nov 27 01:49:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-e4e81422-cd46-444b-9ea5-051ad738a275 req-c0b3b4e2-df3e-4a25-a06d-addca8d13d43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057894 Nov 27 01:49:39 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 114/339] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-b46b9977-3c1a-4a50-99cb-422782d22226 req-35802c15-2207-4809-9367-e0f95f2b6e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fa0915-0bc4-4fb9-9e41-e14d51e993b4", "name": "network-vif-plugged", "status": "completed", "tag": "0e20ea14-2cac-46bc-849d-a97a3e033d3c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b46b9977-3c1a-4a50-99cb-422782d22226 req-35802c15-2207-4809-9367-e0f95f2b6e01 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b46b9977-3c1a-4a50-99cb-422782d22226 req-35802c15-2207-4809-9367-e0f95f2b6e01 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b46b9977-3c1a-4a50-99cb-422782d22226 req-35802c15-2207-4809-9367-e0f95f2b6e01 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b46b9977-3c1a-4a50-99cb-422782d22226 req-35802c15-2207-4809-9367-e0f95f2b6e01 service nova] Creating event network-vif-plugged:0e20ea14-2cac-46bc-849d-a97a3e033d3c for instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 on user Nov 27 01:49:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-b46b9977-3c1a-4a50-99cb-422782d22226 req-35802c15-2207-4809-9367-e0f95f2b6e01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053070 Nov 27 01:49:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 111/340] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: bb3d759e-37a5-45d5-a154-35616a647899] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:40 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: bb3d759e-37a5-45d5-a154-35616a647899] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:49:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5ef28278-ca4f-4893-8ee5-d5bbc80b57be tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899" status: 204 len: 0 microversion: 2.1 time: 0.265502 Nov 27 01:49:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 116/341] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:49:40 2023] DELETE /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:49:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:40 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: bb3d759e-37a5-45d5-a154-35616a647899] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:41 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b460cf65f2b44e42bf5e8297989b0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddad7e6dfb9484aa6a5a842430d6ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3db7fd3f-11d9-4e44-a86f-2a36a8f46556 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899" status: 200 len: 1500 microversion: 2.1 time: 0.288079 Nov 27 01:49:41 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 115/342] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:49:40 2023] GET /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899 => generated 1500 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 01:49:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-17aed257-a2e0-4efc-84d4-62938da06fc6 req-5ab8db3a-d493-4891-8c59-01273a46530d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d94162-bb03-4c5c-98c7-0c5cfdb6de26", "name": "network-vif-plugged", "status": "completed", "tag": "9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-17aed257-a2e0-4efc-84d4-62938da06fc6 req-5ab8db3a-d493-4891-8c59-01273a46530d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-17aed257-a2e0-4efc-84d4-62938da06fc6 req-5ab8db3a-d493-4891-8c59-01273a46530d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-17aed257-a2e0-4efc-84d4-62938da06fc6 req-5ab8db3a-d493-4891-8c59-01273a46530d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-17aed257-a2e0-4efc-84d4-62938da06fc6 req-5ab8db3a-d493-4891-8c59-01273a46530d service nova] Creating event network-vif-plugged:9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4 for instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 on user Nov 27 01:49:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-17aed257-a2e0-4efc-84d4-62938da06fc6 req-5ab8db3a-d493-4891-8c59-01273a46530d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082198 Nov 27 01:49:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 112/343] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:42 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d362d1e4-8b81-493d-abba-f3cdd4df520c req-7b9b188f-15eb-4f6d-997a-db815d531490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3d759e-37a5-45d5-a154-35616a647899", "name": "network-vif-unplugged", "status": "completed", "tag": "60a8e89e-afb2-4e58-9c1f-180d307a0a6e"}, {"server_uuid": "bb3d759e-37a5-45d5-a154-35616a647899", "name": "network-vif-plugged", "status": "completed", "tag": "60a8e89e-afb2-4e58-9c1f-180d307a0a6e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d362d1e4-8b81-493d-abba-f3cdd4df520c req-7b9b188f-15eb-4f6d-997a-db815d531490 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d362d1e4-8b81-493d-abba-f3cdd4df520c req-7b9b188f-15eb-4f6d-997a-db815d531490 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d362d1e4-8b81-493d-abba-f3cdd4df520c req-7b9b188f-15eb-4f6d-997a-db815d531490 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d362d1e4-8b81-493d-abba-f3cdd4df520c req-7b9b188f-15eb-4f6d-997a-db815d531490 service nova] Creating event network-vif-unplugged:60a8e89e-afb2-4e58-9c1f-180d307a0a6e for instance bb3d759e-37a5-45d5-a154-35616a647899 on user Nov 27 01:49:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d362d1e4-8b81-493d-abba-f3cdd4df520c req-7b9b188f-15eb-4f6d-997a-db815d531490 service nova] Creating event network-vif-plugged:60a8e89e-afb2-4e58-9c1f-180d307a0a6e for instance bb3d759e-37a5-45d5-a154-35616a647899 on user Nov 27 01:49:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d362d1e4-8b81-493d-abba-f3cdd4df520c req-7b9b188f-15eb-4f6d-997a-db815d531490 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045356 Nov 27 01:49:42 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 117/344] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:42 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-bf4c0629-baca-478c-9011-80ee0cc80b4c req-857b1725-a1f0-45a5-9c23-9271f38ed7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d94162-bb03-4c5c-98c7-0c5cfdb6de26", "name": "network-vif-plugged", "status": "completed", "tag": "9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4"}, {"server_uuid": "bb3d759e-37a5-45d5-a154-35616a647899", "name": "network-vif-deleted", "tag": "60a8e89e-afb2-4e58-9c1f-180d307a0a6e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bf4c0629-baca-478c-9011-80ee0cc80b4c req-857b1725-a1f0-45a5-9c23-9271f38ed7e7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bf4c0629-baca-478c-9011-80ee0cc80b4c req-857b1725-a1f0-45a5-9c23-9271f38ed7e7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bf4c0629-baca-478c-9011-80ee0cc80b4c req-857b1725-a1f0-45a5-9c23-9271f38ed7e7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-bf4c0629-baca-478c-9011-80ee0cc80b4c req-857b1725-a1f0-45a5-9c23-9271f38ed7e7 service nova] Creating event network-vif-plugged:9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4 for instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 on user Nov 27 01:49:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-bf4c0629-baca-478c-9011-80ee0cc80b4c req-857b1725-a1f0-45a5-9c23-9271f38ed7e7 service nova] Creating event network-vif-deleted:60a8e89e-afb2-4e58-9c1f-180d307a0a6e for instance bb3d759e-37a5-45d5-a154-35616a647899 on user Nov 27 01:49:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-bf4c0629-baca-478c-9011-80ee0cc80b4c req-857b1725-a1f0-45a5-9c23-9271f38ed7e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033468 Nov 27 01:49:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 116/345] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:49:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:45 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9e25e131-5904-45ee-bc44-56bd6b6713a9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291" status: 200 len: 1689 microversion: 2.87 time: 0.452799 Nov 27 01:49:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 113/346] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:49:45 2023] GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291 => generated 1689 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:49:54 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:54 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:54 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c33b5f3d-70cd-46b0-94e0-c8ec1b8aef88 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1726625314", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5a4a3ed7-f698-41ee-95b0-55387bed736c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "5787a76f-5250-487c-9397-6a4bfd68e364"}]}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:49:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-c33b5f3d-70cd-46b0-94e0-c8ec1b8aef88 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] HTTP exception thrown: Block Device 5a4a3ed7-f698-41ee-95b0-55387bed736c is not bootable. Nov 27 01:49:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c33b5f3d-70cd-46b0-94e0-c8ec1b8aef88 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Returning 400 to user: Block Device 5a4a3ed7-f698-41ee-95b0-55387bed736c is not bootable. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:49:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c33b5f3d-70cd-46b0-94e0-c8ec1b8aef88 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.092425 Nov 27 01:49:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 118/347] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:49:54 2023] POST /compute/v2.1/servers => generated 110 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=16 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:54 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:49:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-dc9ccfc6-a070-4947-a84f-41e7284ecf73 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 200 len: 1492 microversion: 2.1 time: 0.219386 Nov 27 01:49:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 117/348] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:49:54 2023] GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 1492 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=12 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=16 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:59 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d2a15956-38c8-484f-ab23-d5c5bed44784 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments/50e56f15-9bea-4b1c-aba8-938b46953d4d" status: 200 len: 194 microversion: 2.20 time: 0.224262 Nov 27 01:49:59 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 114/349] 10.0.0.210 () {64 vars in 1531 bytes} [Mon Nov 27 01:49:58 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments/50e56f15-9bea-4b1c-aba8-938b46953d4d => generated 194 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a7de3681-0cf8-4a1b-a166-a8d5e6fbef00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.334595 Nov 27 01:49:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 119/350] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:49:58 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-interface => generated 282 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:49:59 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lazy-loading 'services' on Instance uuid ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:49:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-aecc031e-b720-4521-ac86-19b4b006a813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments/50e56f15-9bea-4b1c-aba8-938b46953d4d" status: 202 len: 0 microversion: 2.20 time: 0.229591 Nov 27 01:49:59 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 118/351] 10.0.0.210 () {64 vars in 1534 bytes} [Mon Nov 27 01:49:59 2023] DELETE /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments/50e56f15-9bea-4b1c-aba8-938b46953d4d => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:49:59 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:49:59 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:49:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:49:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:49:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:49:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-fd09c865-bb1f-45c1-8fdb-62edfe76b62e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049737 Nov 27 01:49:59 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 115/352] 10.0.0.210 () {64 vars in 1420 bytes} [Mon Nov 27 01:49:59 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-aa3087ca-3c25-4db0-96fe-d96eabb2ba38 req-996aae97-b348-4b7b-aaf9-f009735ac231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-aa3087ca-3c25-4db0-96fe-d96eabb2ba38 req-996aae97-b348-4b7b-aaf9-f009735ac231 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-aa3087ca-3c25-4db0-96fe-d96eabb2ba38 req-996aae97-b348-4b7b-aaf9-f009735ac231 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-aa3087ca-3c25-4db0-96fe-d96eabb2ba38 req-996aae97-b348-4b7b-aaf9-f009735ac231 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-aa3087ca-3c25-4db0-96fe-d96eabb2ba38 req-996aae97-b348-4b7b-aaf9-f009735ac231 service nova] Creating event network-changed:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:50:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-aa3087ca-3c25-4db0-96fe-d96eabb2ba38 req-996aae97-b348-4b7b-aaf9-f009735ac231 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033548 Nov 27 01:50:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 120/353] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:00 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9a398316-5093-406b-9852-eae3f25f89d2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 200 len: 1542 microversion: 2.1 time: 0.182122 Nov 27 01:50:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 116/354] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:00 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 1542 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b3c186f-bfd9-4dfd-b1a5-030820030dd1"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:00 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a1fdc565-c932-438c-bcd3-0bb8a1dd0c1e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 200 len: 1487 microversion: 2.1 time: 0.392985 Nov 27 01:50:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 119/355] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:00 2023] GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 1487 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-639cbdf0-0060-47a2-abbd-fab6e13c233a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400544 Nov 27 01:50:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 121/356] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:50:00 2023] POST /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=18 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:11 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9bf4a415-38d7-48b4-b238-06e4b5f3d3eb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 200 len: 1707 microversion: 2.1 time: 0.213128 Nov 27 01:50:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 117/357] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:10 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 1707 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestOtherA-server-738488092", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for project 25a6f8db8baf4e9988fc1ca048107122. Resources: dict_keys(['metadata_items']) {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for user 4d1d312ea9224e4b9e57e5576276a485 and project 25a6f8db8baf4e9988fc1ca048107122. Resources: dict_keys(['metadata_items']) {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c14977f9-2b8e-4bf0-b952-d9152e75619e tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/action" status: 202 len: 1161 microversion: 2.1 time: 0.477529 Nov 27 01:50:11 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 120/358] 10.0.0.210 () {64 vars in 1356 bytes} [Mon Nov 27 01:50:11 2023] POST /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/action => generated 1161 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=8 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:11 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-cccf57f9-b1ed-4369-9cdb-2c870b17734a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 200 len: 1734 microversion: 2.1 time: 0.191480 Nov 27 01:50:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 122/359] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:11 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:13 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-75f7b601-763c-4111-aee3-d899950a8328 req-ab2fae30-603b-4d7c-827c-c5bcefbf5310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-unplugged", "status": "completed", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-75f7b601-763c-4111-aee3-d899950a8328 req-ab2fae30-603b-4d7c-827c-c5bcefbf5310 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-75f7b601-763c-4111-aee3-d899950a8328 req-ab2fae30-603b-4d7c-827c-c5bcefbf5310 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-75f7b601-763c-4111-aee3-d899950a8328 req-ab2fae30-603b-4d7c-827c-c5bcefbf5310 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-75f7b601-763c-4111-aee3-d899950a8328 req-ab2fae30-603b-4d7c-827c-c5bcefbf5310 service nova] Creating event network-vif-unplugged:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:50:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-75f7b601-763c-4111-aee3-d899950a8328 req-ab2fae30-603b-4d7c-827c-c5bcefbf5310 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029712 Nov 27 01:50:13 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 118/360] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-24161aeb-b0e4-4bc0-a1e6-e2d43ac5cbcc req-efecfb64-e01c-4751-9f28-23f8d95d8d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-plugged", "status": "completed", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-24161aeb-b0e4-4bc0-a1e6-e2d43ac5cbcc req-efecfb64-e01c-4751-9f28-23f8d95d8d31 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-24161aeb-b0e4-4bc0-a1e6-e2d43ac5cbcc req-efecfb64-e01c-4751-9f28-23f8d95d8d31 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-24161aeb-b0e4-4bc0-a1e6-e2d43ac5cbcc req-efecfb64-e01c-4751-9f28-23f8d95d8d31 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-24161aeb-b0e4-4bc0-a1e6-e2d43ac5cbcc req-efecfb64-e01c-4751-9f28-23f8d95d8d31 service nova] Creating event network-vif-plugged:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:50:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-24161aeb-b0e4-4bc0-a1e6-e2d43ac5cbcc req-efecfb64-e01c-4751-9f28-23f8d95d8d31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037663 Nov 27 01:50:15 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 121/361] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:16 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:16 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:16 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c50c516a-8a65-4fe3-bab1-9306053b76e9 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "POST /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/action" status: 202 len: 0 microversion: 2.1 time: 0.367854 Nov 27 01:50:16 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 123/362] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:50:16 2023] POST /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:50:16 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:16 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:16 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3372685e-82fe-4c97-a39d-8d46ff418e18 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.161598 Nov 27 01:50:16 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 119/363] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:50:16 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-interface => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-532cc028-ee8c-4140-9ad0-db8d22d7df44 req-5ade640b-57fa-4338-bc86-de1da8e4fc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-unplugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-532cc028-ee8c-4140-9ad0-db8d22d7df44 req-5ade640b-57fa-4338-bc86-de1da8e4fc79 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-532cc028-ee8c-4140-9ad0-db8d22d7df44 req-5ade640b-57fa-4338-bc86-de1da8e4fc79 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-532cc028-ee8c-4140-9ad0-db8d22d7df44 req-5ade640b-57fa-4338-bc86-de1da8e4fc79 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-532cc028-ee8c-4140-9ad0-db8d22d7df44 req-5ade640b-57fa-4338-bc86-de1da8e4fc79 service nova] Creating event network-vif-unplugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:50:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-532cc028-ee8c-4140-9ad0-db8d22d7df44 req-5ade640b-57fa-4338-bc86-de1da8e4fc79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148535 Nov 27 01:50:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-73d9f5b3-8dcc-4cf2-b574-19e14ac024cf req-6b545801-9cda-4d4b-9659-25c2a4399606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}, {"name": "network-changed", "server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}, {"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73d9f5b3-8dcc-4cf2-b574-19e14ac024cf req-6b545801-9cda-4d4b-9659-25c2a4399606 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73d9f5b3-8dcc-4cf2-b574-19e14ac024cf req-6b545801-9cda-4d4b-9659-25c2a4399606 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73d9f5b3-8dcc-4cf2-b574-19e14ac024cf req-6b545801-9cda-4d4b-9659-25c2a4399606 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-73d9f5b3-8dcc-4cf2-b574-19e14ac024cf req-6b545801-9cda-4d4b-9659-25c2a4399606 service nova] Creating event network-changed:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:50:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-73d9f5b3-8dcc-4cf2-b574-19e14ac024cf req-6b545801-9cda-4d4b-9659-25c2a4399606 service nova] Creating event network-changed:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:50:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-73d9f5b3-8dcc-4cf2-b574-19e14ac024cf req-6b545801-9cda-4d4b-9659-25c2a4399606 service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:50:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-73d9f5b3-8dcc-4cf2-b574-19e14ac024cf req-6b545801-9cda-4d4b-9659-25c2a4399606 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.067317 Nov 27 01:50:20 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 124/365] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:19 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:21 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-1e02d72d-8ca2-4407-88e6-2b8692703b20 req-62ed8f77-944e-4608-9b4f-f0f1aa69a1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}, {"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1e02d72d-8ca2-4407-88e6-2b8692703b20 req-62ed8f77-944e-4608-9b4f-f0f1aa69a1cc service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1e02d72d-8ca2-4407-88e6-2b8692703b20 req-62ed8f77-944e-4608-9b4f-f0f1aa69a1cc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1e02d72d-8ca2-4407-88e6-2b8692703b20 req-62ed8f77-944e-4608-9b4f-f0f1aa69a1cc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-1e02d72d-8ca2-4407-88e6-2b8692703b20 req-62ed8f77-944e-4608-9b4f-f0f1aa69a1cc service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:50:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-1e02d72d-8ca2-4407-88e6-2b8692703b20 req-62ed8f77-944e-4608-9b4f-f0f1aa69a1cc service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:50:22 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f516a04e9548be9fdfde99560a2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6c26710e74c5388a4bde76dc6c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-1e02d72d-8ca2-4407-88e6-2b8692703b20 req-62ed8f77-944e-4608-9b4f-f0f1aa69a1cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039590 Nov 27 01:50:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 123/366] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-788b248c-d7eb-406b-b0ae-9eafc0c68c3f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4" status: 200 len: 1547 microversion: 2.1 time: 0.305897 Nov 27 01:50:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 120/367] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:21 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 => generated 1547 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:23 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ab26b246-4ba7-4e47-9095-2376e6b06e6d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'create', calling method: .version_select at 0x7f364b3bfeb0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-21288415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJXulr003PlxMKuwRz4blJGW0gzr6hOeJZ3GAwpoX60T7pzNs3C/SV9JsRAypCB+eKSejLwLPurAfZGCEGtrMZa7EzemY941JLUz/8uyLb4zoBxP55GFYufIDQsyUT7IA=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:23 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-ab26b246-4ba7-4e47-9095-2376e6b06e6d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Getting quotas for project d7e2e5ce3c4145fb92668e1a767d9881. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:50:23 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-ab26b246-4ba7-4e47-9095-2376e6b06e6d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Getting quotas for user 10716a7e05b54eef981b7c20e6b796ce and project d7e2e5ce3c4145fb92668e1a767d9881. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:50:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ab26b246-4ba7-4e47-9095-2376e6b06e6d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.063564 Nov 27 01:50:23 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 125/368] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:50:23 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:50:23 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1970682101", "imageRef": "94ac552b-929c-454a-9d15-8415e5d4ea2f", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-21288415", "networks": [{"uuid": "306b810a-8eb3-47fc-9c31-263d2db4207d"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:23 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] validate_networks() for [('306b810a-8eb3-47fc-9c31-263d2db4207d', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Getting quotas for project d7e2e5ce3c4145fb92668e1a767d9881. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Getting quotas for user 10716a7e05b54eef981b7c20e6b796ce and project d7e2e5ce3c4145fb92668e1a767d9881. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:50:24 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='94ac552b-929c-454a-9d15-8415e5d4ea2f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:50:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-59f5d51c-acec-4cca-99cb-fc53ea6dd7bf tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.252338 Nov 27 01:50:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 124/369] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:50:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:50:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ca017f67-fd37-4b27-9846-1ce520b21934 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:24 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ca017f67-fd37-4b27-9846-1ce520b21934 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:24 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-ca017f67-fd37-4b27-9846-1ce520b21934 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ca017f67-fd37-4b27-9846-1ce520b21934 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1249 microversion: 2.1 time: 0.117453 Nov 27 01:50:24 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 121/370] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:24 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1249 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 01:50:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:26 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:27 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c646987f224bff8087f028e03712d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7220ed7a6df4d2ca599344d306270a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3809f575-3c41-4399-a658-a31fefb0dcd1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26" status: 200 len: 1488 microversion: 2.1 time: 1.053698 Nov 27 01:50:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 126/371] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:26 2023] GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26 => generated 1488 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:27 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-d0d51bd1-d09f-4754-a39f-744a2d3a861c req-6b855b5e-9d52-4005-9a73-356a093e2c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-plugged", "status": "completed", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d0d51bd1-d09f-4754-a39f-744a2d3a861c req-6b855b5e-9d52-4005-9a73-356a093e2c4c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d0d51bd1-d09f-4754-a39f-744a2d3a861c req-6b855b5e-9d52-4005-9a73-356a093e2c4c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d0d51bd1-d09f-4754-a39f-744a2d3a861c req-6b855b5e-9d52-4005-9a73-356a093e2c4c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-d0d51bd1-d09f-4754-a39f-744a2d3a861c req-6b855b5e-9d52-4005-9a73-356a093e2c4c service nova] Creating event network-vif-plugged:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:50:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-d0d51bd1-d09f-4754-a39f-744a2d3a861c req-6b855b5e-9d52-4005-9a73-356a093e2c4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043546 Nov 27 01:50:27 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 125/372] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:29 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-3f34feec-bb91-410b-8649-36b25c811679 req-a92ee3df-e171-4efc-bcbb-e73eedbf9cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-plugged", "status": "completed", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}, {"name": "network-changed", "server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3f34feec-bb91-410b-8649-36b25c811679 req-a92ee3df-e171-4efc-bcbb-e73eedbf9cdc service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3f34feec-bb91-410b-8649-36b25c811679 req-a92ee3df-e171-4efc-bcbb-e73eedbf9cdc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3f34feec-bb91-410b-8649-36b25c811679 req-a92ee3df-e171-4efc-bcbb-e73eedbf9cdc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-3f34feec-bb91-410b-8649-36b25c811679 req-a92ee3df-e171-4efc-bcbb-e73eedbf9cdc service nova] Creating event network-vif-plugged:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:50:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-3f34feec-bb91-410b-8649-36b25c811679 req-a92ee3df-e171-4efc-bcbb-e73eedbf9cdc service nova] Creating event network-changed:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:50:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-3f34feec-bb91-410b-8649-36b25c811679 req-a92ee3df-e171-4efc-bcbb-e73eedbf9cdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055297 Nov 27 01:50:30 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 122/373] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:29 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-28107e58-a378-4b7d-8f67-cb94bf9ff576 req-7ff700bb-867b-49bc-ae61-949f493af6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-28107e58-a378-4b7d-8f67-cb94bf9ff576 req-7ff700bb-867b-49bc-ae61-949f493af6e8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-28107e58-a378-4b7d-8f67-cb94bf9ff576 req-7ff700bb-867b-49bc-ae61-949f493af6e8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-28107e58-a378-4b7d-8f67-cb94bf9ff576 req-7ff700bb-867b-49bc-ae61-949f493af6e8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-28107e58-a378-4b7d-8f67-cb94bf9ff576 req-7ff700bb-867b-49bc-ae61-949f493af6e8 service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:50:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-28107e58-a378-4b7d-8f67-cb94bf9ff576 req-7ff700bb-867b-49bc-ae61-949f493af6e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048029 Nov 27 01:50:31 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 127/374] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: bb3d759e-37a5-45d5-a154-35616a647899] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] HTTP exception thrown: Instance bb3d759e-37a5-45d5-a154-35616a647899 could not be found. Nov 27 01:50:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Returning 404 to user: Instance bb3d759e-37a5-45d5-a154-35616a647899 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:50:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-cb2e302e-3e73-44d2-9b14-d684d799fa65 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899" status: 404 len: 111 microversion: 2.1 time: 0.036201 Nov 27 01:50:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 126/375] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:31 2023] GET /compute/v2.1/servers/bb3d759e-37a5-45d5-a154-35616a647899 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:50:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-6d685e75-7374-4ca2-923a-48b1d725ea52 req-81c72484-bb57-427e-b119-665c15436633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6d685e75-7374-4ca2-923a-48b1d725ea52 req-81c72484-bb57-427e-b119-665c15436633 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6d685e75-7374-4ca2-923a-48b1d725ea52 req-81c72484-bb57-427e-b119-665c15436633 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6d685e75-7374-4ca2-923a-48b1d725ea52 req-81c72484-bb57-427e-b119-665c15436633 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-6d685e75-7374-4ca2-923a-48b1d725ea52 req-81c72484-bb57-427e-b119-665c15436633 service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:50:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-6d685e75-7374-4ca2-923a-48b1d725ea52 req-81c72484-bb57-427e-b119-665c15436633 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040712 Nov 27 01:50:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 123/376] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:35 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:50:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a74f8580-739d-40a5-a72c-a38c8d28545c tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8" status: 204 len: 0 microversion: 2.1 time: 0.164088 Nov 27 01:50:35 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 128/377] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:50:35 2023] DELETE /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:36 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:36 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d8bbc3b4-95dc-4669-a46f-834df57fa54f req-ece17be7-6fba-410c-8b8e-6f5fea310870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c1f4ed-6972-47f9-8578-4105ce4d7df8", "name": "network-vif-unplugged", "status": "completed", "tag": "4f81c4fe-650f-481d-93ef-8b0e523d0f28"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d8bbc3b4-95dc-4669-a46f-834df57fa54f req-ece17be7-6fba-410c-8b8e-6f5fea310870 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d8bbc3b4-95dc-4669-a46f-834df57fa54f req-ece17be7-6fba-410c-8b8e-6f5fea310870 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d8bbc3b4-95dc-4669-a46f-834df57fa54f req-ece17be7-6fba-410c-8b8e-6f5fea310870 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d8bbc3b4-95dc-4669-a46f-834df57fa54f req-ece17be7-6fba-410c-8b8e-6f5fea310870 service nova] Creating event network-vif-unplugged:4f81c4fe-650f-481d-93ef-8b0e523d0f28 for instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 on user Nov 27 01:50:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-d8bbc3b4-95dc-4669-a46f-834df57fa54f req-ece17be7-6fba-410c-8b8e-6f5fea310870 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050953 Nov 27 01:50:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 124/378] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:36 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b460cf65f2b44e42bf5e8297989b0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddad7e6dfb9484aa6a5a842430d6ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:36 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9b98b577-1b0a-46c6-919f-50838182f767 tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8" status: 200 len: 1668 microversion: 2.1 time: 0.348121 Nov 27 01:50:36 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:35 2023] GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8 => generated 1668 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:37 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-bc65fc33-aacf-43d4-94eb-42cc6c184113 req-bb021120-abe5-4f14-b92b-67fbf5c10afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c1f4ed-6972-47f9-8578-4105ce4d7df8", "name": "network-vif-deleted", "tag": "4f81c4fe-650f-481d-93ef-8b0e523d0f28"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bc65fc33-aacf-43d4-94eb-42cc6c184113 req-bb021120-abe5-4f14-b92b-67fbf5c10afb service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bc65fc33-aacf-43d4-94eb-42cc6c184113 req-bb021120-abe5-4f14-b92b-67fbf5c10afb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bc65fc33-aacf-43d4-94eb-42cc6c184113 req-bb021120-abe5-4f14-b92b-67fbf5c10afb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:37 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-bc65fc33-aacf-43d4-94eb-42cc6c184113 req-bb021120-abe5-4f14-b92b-67fbf5c10afb service nova] Creating event network-vif-deleted:4f81c4fe-650f-481d-93ef-8b0e523d0f28 for instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 on user Nov 27 01:50:37 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-bc65fc33-aacf-43d4-94eb-42cc6c184113 req-bb021120-abe5-4f14-b92b-67fbf5c10afb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033301 Nov 27 01:50:37 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 129/380] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:38 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-106b3a35-46fd-499c-8373-30affc726a06 req-6b893ed8-a492-496e-811d-c71fa543f953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c1f4ed-6972-47f9-8578-4105ce4d7df8", "name": "network-vif-plugged", "status": "completed", "tag": "4f81c4fe-650f-481d-93ef-8b0e523d0f28"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-106b3a35-46fd-499c-8373-30affc726a06 req-6b893ed8-a492-496e-811d-c71fa543f953 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-106b3a35-46fd-499c-8373-30affc726a06 req-6b893ed8-a492-496e-811d-c71fa543f953 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-106b3a35-46fd-499c-8373-30affc726a06 req-6b893ed8-a492-496e-811d-c71fa543f953 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-106b3a35-46fd-499c-8373-30affc726a06 req-6b893ed8-a492-496e-811d-c71fa543f953 service nova] Creating event network-vif-plugged:4f81c4fe-650f-481d-93ef-8b0e523d0f28 for instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 on user Nov 27 01:50:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-106b3a35-46fd-499c-8373-30affc726a06 req-6b893ed8-a492-496e-811d-c71fa543f953 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033067 Nov 27 01:50:38 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 125/381] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:39 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:39 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-701642cf-4df2-4c08-b680-5968b4756eb0 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.167971 Nov 27 01:50:39 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 128/382] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:50:39 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-interface => generated 282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-61609e37-1125-4398-91b9-5aaa564c5d3f req-351cc9a9-50e0-4157-99bf-7fa86332a324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-61609e37-1125-4398-91b9-5aaa564c5d3f req-351cc9a9-50e0-4157-99bf-7fa86332a324 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-61609e37-1125-4398-91b9-5aaa564c5d3f req-351cc9a9-50e0-4157-99bf-7fa86332a324 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-61609e37-1125-4398-91b9-5aaa564c5d3f req-351cc9a9-50e0-4157-99bf-7fa86332a324 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-61609e37-1125-4398-91b9-5aaa564c5d3f req-351cc9a9-50e0-4157-99bf-7fa86332a324 service nova] Creating event network-changed:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:50:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-61609e37-1125-4398-91b9-5aaa564c5d3f req-351cc9a9-50e0-4157-99bf-7fa86332a324 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044601 Nov 27 01:50:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 130/383] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:40 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61091e519f55480db63568e194c5b3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed38a15ada7a48a9b490cfef0cc09f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-5c7f819e-b555-4ce3-9438-9507f2c328cc tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee" status: 200 len: 1575 microversion: 2.1 time: 0.268515 Nov 27 01:50:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 126/384] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:40 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61091e519f55480db63568e194c5b3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed38a15ada7a48a9b490cfef0cc09f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Searching by: {'deleted': False, 'project_id': 'ed38a15ada7a48a9b490cfef0cc09f8f'} {{(pid=65192) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:40 user devstack@n-api.service[65192]: DEBUG nova.compute.multi_cell_list [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65192) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 01:50:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-bb62bfc8-ec92-4371-bd12-c8a4f5d73c3d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 357 microversion: 2.1 time: 0.199208 Nov 27 01:50:40 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 129/385] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Nov 27 01:50:40 2023] GET /compute/v2.1/servers => generated 357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8331a8bc-fffc-451e-9717-cc19d2f81bc5"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:43 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4000ad25-3648-4983-ace9-2bef1b770036 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471097 Nov 27 01:50:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 131/386] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:50:43 2023] POST /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1989081021"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:45 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:46 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-922d1f17-9a5e-4df2-aeb8-52fc90079055 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291/action" status: 202 len: 52 microversion: 2.87 time: 0.922154 Nov 27 01:50:46 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 127/387] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 01:50:45 2023] POST /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291/action => generated 52 bytes in 925 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7be22a4f-2168-46d9-baa0-980966a1444e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051981 Nov 27 01:50:49 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 130/388] 10.0.0.210 () {64 vars in 1420 bytes} [Mon Nov 27 01:50:49 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:50:49 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-64a252cf-dbc5-44bb-96f0-a69258c5d09f tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 204 len: 0 microversion: 2.20 time: 0.115595 Nov 27 01:50:49 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 132/389] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:50:49 2023] DELETE /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 01:50:49 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lazy-loading 'services' on Instance uuid 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-f0622fea-f474-4d9a-b9bc-44716c6f18c7 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-volume_attachments/9f87fb7b-d3b4-480d-a5f8-a65737a984d9" status: 202 len: 0 microversion: 2.1 time: 0.185611 Nov 27 01:50:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 128/390] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:50:49 2023] DELETE /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-volume_attachments/9f87fb7b-d3b4-480d-a5f8-a65737a984d9 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:49 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c900a632-7488-42cf-9f31-417b9ff7d80f tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129657 Nov 27 01:50:49 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 133/391] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:50:49 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:50 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:50 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:50 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:50 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e6533a3f-0f29-4cfd-b68f-c1cbc13a8914 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 200 len: 1710 microversion: 2.20 time: 0.352181 Nov 27 01:50:50 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 131/392] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:50:49 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 1710 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:50:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-aa763919-3acc-41c9-90a3-5233499ae623 req-d41a6fce-54b3-4881-8d36-a99d68c0ab6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-unplugged", "status": "completed", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-aa763919-3acc-41c9-90a3-5233499ae623 req-d41a6fce-54b3-4881-8d36-a99d68c0ab6a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-aa763919-3acc-41c9-90a3-5233499ae623 req-d41a6fce-54b3-4881-8d36-a99d68c0ab6a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-aa763919-3acc-41c9-90a3-5233499ae623 req-d41a6fce-54b3-4881-8d36-a99d68c0ab6a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-aa763919-3acc-41c9-90a3-5233499ae623 req-d41a6fce-54b3-4881-8d36-a99d68c0ab6a service nova] Creating event network-vif-unplugged:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:50:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-aa763919-3acc-41c9-90a3-5233499ae623 req-d41a6fce-54b3-4881-8d36-a99d68c0ab6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031377 Nov 27 01:50:50 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 129/393] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:51 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-36037da0-4aa4-438e-b03c-11e00d64ebf7 req-24104bc2-e555-46b9-9179-70e1dcd8a6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-deleted", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-36037da0-4aa4-438e-b03c-11e00d64ebf7 req-24104bc2-e555-46b9-9179-70e1dcd8a6f2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-36037da0-4aa4-438e-b03c-11e00d64ebf7 req-24104bc2-e555-46b9-9179-70e1dcd8a6f2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-36037da0-4aa4-438e-b03c-11e00d64ebf7 req-24104bc2-e555-46b9-9179-70e1dcd8a6f2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:51 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-36037da0-4aa4-438e-b03c-11e00d64ebf7 req-24104bc2-e555-46b9-9179-70e1dcd8a6f2 service nova] Creating event network-vif-deleted:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:50:51 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-36037da0-4aa4-438e-b03c-11e00d64ebf7 req-24104bc2-e555-46b9-9179-70e1dcd8a6f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032943 Nov 27 01:50:51 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 134/394] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:52 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-8dcca54c-5a40-476e-af86-e7594dddc973 req-29e4e149-f7c8-4f1c-a68f-444cabf51d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4", "name": "network-vif-plugged", "status": "completed", "tag": "a7dc1f11-3807-441a-951b-956c06d21310"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:50:52 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:50:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8dcca54c-5a40-476e-af86-e7594dddc973 req-29e4e149-f7c8-4f1c-a68f-444cabf51d7d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8dcca54c-5a40-476e-af86-e7594dddc973 req-29e4e149-f7c8-4f1c-a68f-444cabf51d7d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8dcca54c-5a40-476e-af86-e7594dddc973 req-29e4e149-f7c8-4f1c-a68f-444cabf51d7d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-8dcca54c-5a40-476e-af86-e7594dddc973 req-29e4e149-f7c8-4f1c-a68f-444cabf51d7d service nova] Creating event network-vif-plugged:a7dc1f11-3807-441a-951b-956c06d21310 for instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 on user Nov 27 01:50:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-8dcca54c-5a40-476e-af86-e7594dddc973 req-29e4e149-f7c8-4f1c-a68f-444cabf51d7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035221 Nov 27 01:50:52 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:50:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:53 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-35069b76-d633-4cb0-812e-242e2f0f0b69 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291" status: 200 len: 1702 microversion: 2.87 time: 0.253951 Nov 27 01:50:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 130/396] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:50:53 2023] GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291 => generated 1702 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG nova.compute.api [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c9db6a12-d7a1-4b09-904e-248de2eb8d19 req-1e376e29-ee7c-4327-beaf-3cd97b353caa tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments/8331a8bc-fffc-451e-9717-cc19d2f81bc5" status: 200 len: 302 microversion: 2.89 time: 0.187996 Nov 27 01:50:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 135/397] 10.0.0.210 () {66 vars in 1638 bytes} [Mon Nov 27 01:50:54 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments/8331a8bc-fffc-451e-9717-cc19d2f81bc5 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG nova.compute.api [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-d2bf6996-f77b-4f35-8faa-01fa1e4a304b req-687e42de-434a-43c0-958c-28c1d01a01ef tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments/8331a8bc-fffc-451e-9717-cc19d2f81bc5" status: 200 len: 302 microversion: 2.89 time: 0.104843 Nov 27 01:50:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 133/398] 10.0.0.210 () {66 vars in 1638 bytes} [Mon Nov 27 01:50:54 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments/8331a8bc-fffc-451e-9717-cc19d2f81bc5 => generated 302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lazy-loading 'services' on Instance uuid dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:50:54 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:50:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c92b69dd-93ba-4626-9687-a2501643a1f5 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 200 len: 1492 microversion: 2.1 time: 0.206514 Nov 27 01:50:54 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 131/399] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:50:54 2023] GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 1492 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:50:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-98ee1428-546f-40cb-af99-be5bd0b7852b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments/8331a8bc-fffc-451e-9717-cc19d2f81bc5" status: 202 len: 0 microversion: 2.1 time: 0.209954 Nov 27 01:50:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 136/400] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:50:54 2023] DELETE /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments/8331a8bc-fffc-451e-9717-cc19d2f81bc5 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:50:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:50:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-dc7345e5-5e6a-413d-a009-2866063883f7 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081699 Nov 27 01:50:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:50:54 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "650707c8-fa49-41ea-99dc-5e274f2bfc5d"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] HTTP exception thrown: Cannot 'attach_volume' instance cd137692-54b9-481d-b758-b9f1a5e67b82 while it is in vm_state rescued Nov 27 01:51:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Returning 409 to user: Cannot 'attach_volume' instance cd137692-54b9-481d-b758-b9f1a5e67b82 while it is in vm_state rescued {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:51:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6a88d623-27ee-46e0-97e8-7366ebc2db8e tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041937 Nov 27 01:51:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 132/402] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:51:00 2023] POST /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 01:51:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:00 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a90f3346-d8e3-4690-95e1-5e4d537c8670 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82/action" status: 202 len: 0 microversion: 2.1 time: 0.081821 Nov 27 01:51:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 137/403] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:51:00 2023] POST /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:51:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:00 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:01 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ad1d7d38-6ce6-45d4-8e92-8b50acf27696 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 200 len: 1495 microversion: 2.1 time: 0.220047 Nov 27 01:51:01 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:00 2023] GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 1495 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:01 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-c1a6dea2-22cc-47bc-8d2b-89063e10a9ca req-2ef5aacc-df77-4123-a38c-9ba46ad78aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-unplugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c1a6dea2-22cc-47bc-8d2b-89063e10a9ca req-2ef5aacc-df77-4123-a38c-9ba46ad78aa0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c1a6dea2-22cc-47bc-8d2b-89063e10a9ca req-2ef5aacc-df77-4123-a38c-9ba46ad78aa0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c1a6dea2-22cc-47bc-8d2b-89063e10a9ca req-2ef5aacc-df77-4123-a38c-9ba46ad78aa0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-c1a6dea2-22cc-47bc-8d2b-89063e10a9ca req-2ef5aacc-df77-4123-a38c-9ba46ad78aa0 service nova] Creating event network-vif-unplugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:51:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-c1a6dea2-22cc-47bc-8d2b-89063e10a9ca req-2ef5aacc-df77-4123-a38c-9ba46ad78aa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030556 Nov 27 01:51:01 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 133/405] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:01 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:01 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:02 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6d26c4bf-0beb-451c-aa52-d510beddc185 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 200 len: 1725 microversion: 2.1 time: 0.200868 Nov 27 01:51:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 138/406] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:01 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:03 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-57d266f7-56be-45be-a440-3a968498be3d req-4ed64d6c-978a-4e94-b72c-65b39ea43c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}, {"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-57d266f7-56be-45be-a440-3a968498be3d req-4ed64d6c-978a-4e94-b72c-65b39ea43c95 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-57d266f7-56be-45be-a440-3a968498be3d req-4ed64d6c-978a-4e94-b72c-65b39ea43c95 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-57d266f7-56be-45be-a440-3a968498be3d req-4ed64d6c-978a-4e94-b72c-65b39ea43c95 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-57d266f7-56be-45be-a440-3a968498be3d req-4ed64d6c-978a-4e94-b72c-65b39ea43c95 service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:51:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-57d266f7-56be-45be-a440-3a968498be3d req-4ed64d6c-978a-4e94-b72c-65b39ea43c95 service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:51:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-57d266f7-56be-45be-a440-3a968498be3d req-4ed64d6c-978a-4e94-b72c-65b39ea43c95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033325 Nov 27 01:51:03 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-f5d2e722-d3f4-4110-a0f0-2d0c0b5ffc22 req-8b555982-5c8f-4aa2-8529-6a93b2859785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f5d2e722-d3f4-4110-a0f0-2d0c0b5ffc22 req-8b555982-5c8f-4aa2-8529-6a93b2859785 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f5d2e722-d3f4-4110-a0f0-2d0c0b5ffc22 req-8b555982-5c8f-4aa2-8529-6a93b2859785 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f5d2e722-d3f4-4110-a0f0-2d0c0b5ffc22 req-8b555982-5c8f-4aa2-8529-6a93b2859785 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-f5d2e722-d3f4-4110-a0f0-2d0c0b5ffc22 req-8b555982-5c8f-4aa2-8529-6a93b2859785 service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 01:51:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-f5d2e722-d3f4-4110-a0f0-2d0c0b5ffc22 req-8b555982-5c8f-4aa2-8529-6a93b2859785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033405 Nov 27 01:51:05 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 134/408] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=110,nova_cell1:UPDATE=8,nova_cell1:INSERT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:14 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-66834c49-0c09-45ac-a50a-dc3c0485a7c5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1531 microversion: 2.1 time: 0.214911 Nov 27 01:51:14 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 139/409] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:14 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1531 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9eddce60-8743-4e95-88e2-edb17fb29b4f tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.163494 Nov 27 01:51:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:51:22 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-interface => generated 282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:23 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=40 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:23 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:23 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-5b50df81-711d-4f2a-b560-640d7448eb56 req-d87d002f-7ff9-4c74-b9cb-6917a687f435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fa0915-0bc4-4fb9-9e41-e14d51e993b4", "tag": "0e20ea14-2cac-46bc-849d-a97a3e033d3c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5b50df81-711d-4f2a-b560-640d7448eb56 req-d87d002f-7ff9-4c74-b9cb-6917a687f435 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5b50df81-711d-4f2a-b560-640d7448eb56 req-d87d002f-7ff9-4c74-b9cb-6917a687f435 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5b50df81-711d-4f2a-b560-640d7448eb56 req-d87d002f-7ff9-4c74-b9cb-6917a687f435 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-5b50df81-711d-4f2a-b560-640d7448eb56 req-d87d002f-7ff9-4c74-b9cb-6917a687f435 service nova] Creating event network-changed:0e20ea14-2cac-46bc-849d-a97a3e033d3c for instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 on user Nov 27 01:51:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-5b50df81-711d-4f2a-b560-640d7448eb56 req-d87d002f-7ff9-4c74-b9cb-6917a687f435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062364 Nov 27 01:51:23 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 135/411] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bd55252-a6cf-4446-932c-decba3765bec"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b2d8005d-8842-4c5a-a081-eacc56a00e30 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331399 Nov 27 01:51:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 140/412] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:51:25 2023] POST /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] [instance: 58c1f4ed-6972-47f9-8578-4105ce4d7df8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] HTTP exception thrown: Instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 could not be found. Nov 27 01:51:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Returning 404 to user: Instance 58c1f4ed-6972-47f9-8578-4105ce4d7df8 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:51:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ba87b93e-07b4-4c28-8dd7-5a905eddcc8e tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8" status: 404 len: 111 microversion: 2.1 time: 0.026683 Nov 27 01:51:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 138/413] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:26 2023] GET /compute/v2.1/servers/58c1f4ed-6972-47f9-8578-4105ce4d7df8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:51:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-5a47d052-11ce-4fbe-8fe7-4622093fc5db tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] Calling method '.version_select at 0x7f364b3f2050>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-5a47d052-11ce-4fbe-8fe7-4622093fc5db tempest-VolumesAdminNegativeTest-1473285317 tempest-VolumesAdminNegativeTest-1473285317-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-917484975" status: 202 len: 0 microversion: 2.1 time: 0.030296 Nov 27 01:51:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 136/414] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 01:51:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-917484975 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:51:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33729e20-d6ef-4507-9ae3-3875b022026c"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:30 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5f3e6191-1ac0-46cf-8856-6ef48739c0e4 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "POST /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295967 Nov 27 01:51:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 141/415] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:51:30 2023] POST /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:34 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e62f23e4-3c8b-4857-98e5-d61ba7b57a1d tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Nov 27 01:51:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 139/416] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:51:34 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:35 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lazy-loading 'services' on Instance uuid d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:51:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-05a9d025-607f-4479-ae57-ef730c9add81 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments/4bd55252-a6cf-4446-932c-decba3765bec" status: 202 len: 0 microversion: 2.1 time: 0.160969 Nov 27 01:51:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 137/417] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:51:34 2023] DELETE /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments/4bd55252-a6cf-4446-932c-decba3765bec => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:51:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b469e33f-62fb-4f27-b606-b782cfa25ca3 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26" status: 204 len: 0 microversion: 2.1 time: 0.134440 Nov 27 01:51:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 142/418] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:51:39 2023] DELETE /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:39 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c646987f224bff8087f028e03712d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7220ed7a6df4d2ca599344d306270a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-325e1fef-f1a1-4e7e-9a0c-aaad65c5eee2 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26" status: 200 len: 1540 microversion: 2.1 time: 0.260096 Nov 27 01:51:39 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 140/419] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:39 2023] GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26 => generated 1540 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:39 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-72898585-f6a2-4d53-93fa-9f45a08306ca req-69986c11-3730-40ef-873d-49897a11632b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d94162-bb03-4c5c-98c7-0c5cfdb6de26", "name": "network-vif-unplugged", "status": "completed", "tag": "9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-72898585-f6a2-4d53-93fa-9f45a08306ca req-69986c11-3730-40ef-873d-49897a11632b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-72898585-f6a2-4d53-93fa-9f45a08306ca req-69986c11-3730-40ef-873d-49897a11632b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-72898585-f6a2-4d53-93fa-9f45a08306ca req-69986c11-3730-40ef-873d-49897a11632b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-72898585-f6a2-4d53-93fa-9f45a08306ca req-69986c11-3730-40ef-873d-49897a11632b service nova] Creating event network-vif-unplugged:9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4 for instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 on user Nov 27 01:51:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-72898585-f6a2-4d53-93fa-9f45a08306ca req-69986c11-3730-40ef-873d-49897a11632b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037309 Nov 27 01:51:39 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 138/420] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-884355e5-a068-4c43-9352-ec8a8ed168a3 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046709 Nov 27 01:51:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 143/421] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:51:39 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:51:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5b60e2b0-1474-4fdb-860e-ced0ed0697af tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '.version_select at 0x7f364b2137f0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] HTTP exception thrown: Instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 could not be found. Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Returning 404 to user: Instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:51:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-88be683b-7ece-4435-8804-52e54bab1966 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 404 len: 111 microversion: 2.20 time: 0.034473 Nov 27 01:51:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 139/422] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:51:40 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-45461314-d958-47f0-9910-aad281abf350 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '.version_select at 0x7f364b232170>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-45461314-d958-47f0-9910-aad281abf350 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538026092" status: 204 len: 0 microversion: 2.20 time: 0.025547 Nov 27 01:51:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 144/423] 10.0.0.210 () {64 vars in 1336 bytes} [Mon Nov 27 01:51:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538026092 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 01:51:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5b60e2b0-1474-4fdb-860e-ced0ed0697af tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/67d9107c-79bc-4e26-bdb3-5cb69980ffb0" status: 204 len: 0 microversion: 2.1 time: 0.290141 Nov 27 01:51:40 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 141/424] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:40 2023] DELETE /compute/v2.1/images/67d9107c-79bc-4e26-bdb3-5cb69980ffb0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:40 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:51:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ca43ee6f-fefb-4681-a04f-ae4d428c482c tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 204 len: 0 microversion: 2.1 time: 0.143509 Nov 27 01:51:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 140/425] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:51:40 2023] DELETE /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-887b61da-bcb2-4ba6-b154-a44cff50eee7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'create', calling method: .version_select at 0x7f364b213910>, body: {"keypair": {"name": "tempest-keypair-461329308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvw7BsLYZMprq2UXv6+SDxKY32MWZkqK2+bosnzX1ZiHvycTmJcOOHukmb2WYlpp4DC1U2DZY1L/AfziNa4KpD0HDM8m0f0yjUiDckS17xNkwMI2ItOu/qvF6/tJX5qIg=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:40 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-887b61da-bcb2-4ba6-b154-a44cff50eee7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Getting quotas for project c0890368fe814dd5b4370275a3d0420f. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:51:40 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-887b61da-bcb2-4ba6-b154-a44cff50eee7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Getting quotas for user 2f1bb99a4d784d28abed0c4dcc03fc03 and project c0890368fe814dd5b4370275a3d0420f. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:51:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-887b61da-bcb2-4ba6-b154-a44cff50eee7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.060388 Nov 27 01:51:40 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 142/426] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Nov 27 01:51:40 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 27 01:51:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3cada557-077c-4713-ace8-614ffc8ea8aa tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Action: 'create', calling method: .version_select at 0x7f364b69c160>, body: {"keypair": {"name": "tempest-keypair-1905395609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjCQO2VHlHdynlGmjS2JlDUeZ+HoloZI9TzRwxbOyPhZ7tPtPPJtE+xm94cNqjHP7ocQk3nGW+epFaH4OOfJSE1gN76r9PyGZ88v5SiGSN8QLfKeKNaYynf1XBIYK8sRw=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:41 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '990555ee1c2a4bfa9858705701a49079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954c903a669a46feadbf6b78531c6639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-42ed69c6-9e90-4cad-b7da-982b4ac0bf04 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 200 len: 1675 microversion: 2.1 time: 0.754907 Nov 27 01:51:41 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 145/427] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:40 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 1675 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:41 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-3cada557-077c-4713-ace8-614ffc8ea8aa tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Getting quotas for project 9364a4c1bedd4dc68e97240fee6eba62. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:51:41 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-3cada557-077c-4713-ace8-614ffc8ea8aa tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Getting quotas for user 18ba391d043d4c798e2046791cf1941d and project 9364a4c1bedd4dc68e97240fee6eba62. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:51:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3cada557-077c-4713-ace8-614ffc8ea8aa tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.93 time: 0.226201 Nov 27 01:51:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 141/428] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Nov 27 01:51:41 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 27 01:51:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-59598743-835e-4c3d-9811-6172ab6d4c16 req-a478936a-ca59-4216-90d6-e24e97490414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-unplugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-59598743-835e-4c3d-9811-6172ab6d4c16 req-a478936a-ca59-4216-90d6-e24e97490414 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-59598743-835e-4c3d-9811-6172ab6d4c16 req-a478936a-ca59-4216-90d6-e24e97490414 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-59598743-835e-4c3d-9811-6172ab6d4c16 req-a478936a-ca59-4216-90d6-e24e97490414 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-59598743-835e-4c3d-9811-6172ab6d4c16 req-a478936a-ca59-4216-90d6-e24e97490414 service nova] Creating event network-vif-unplugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:51:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-59598743-835e-4c3d-9811-6172ab6d4c16 req-a478936a-ca59-4216-90d6-e24e97490414 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030201 Nov 27 01:51:41 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 143/429] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:41 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d2b2f8c0-a1e8-4733-9742-c445ef132e9b req-b47958dd-c3b8-4d00-abff-ab2c41bb6369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d94162-bb03-4c5c-98c7-0c5cfdb6de26", "name": "network-vif-plugged", "status": "completed", "tag": "9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4"}, {"server_uuid": "99d94162-bb03-4c5c-98c7-0c5cfdb6de26", "name": "network-vif-deleted", "tag": "9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d2b2f8c0-a1e8-4733-9742-c445ef132e9b req-b47958dd-c3b8-4d00-abff-ab2c41bb6369 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d2b2f8c0-a1e8-4733-9742-c445ef132e9b req-b47958dd-c3b8-4d00-abff-ab2c41bb6369 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d2b2f8c0-a1e8-4733-9742-c445ef132e9b req-b47958dd-c3b8-4d00-abff-ab2c41bb6369 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d2b2f8c0-a1e8-4733-9742-c445ef132e9b req-b47958dd-c3b8-4d00-abff-ab2c41bb6369 service nova] Creating event network-vif-plugged:9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4 for instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 on user Nov 27 01:51:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d2b2f8c0-a1e8-4733-9742-c445ef132e9b req-b47958dd-c3b8-4d00-abff-ab2c41bb6369 service nova] Creating event network-vif-deleted:9b9f1cdd-d1f3-4234-8f1b-87a903b34dd4 for instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 on user Nov 27 01:51:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d2b2f8c0-a1e8-4733-9742-c445ef132e9b req-b47958dd-c3b8-4d00-abff-ab2c41bb6369 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039999 Nov 27 01:51:41 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 146/430] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:42 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-329055153", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e9b21e97-cc0e-48a9-8063-120df80128e5"}], "security_groups": [{"name": "tempest-securitygroup--1458299251"}], "key_name": "tempest-keypair-461329308", "user_data": "}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:42 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] validate_networks() for [('e9b21e97-cc0e-48a9-8063-120df80128e5', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Getting quotas for project c0890368fe814dd5b4370275a3d0420f. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Getting quotas for user 2f1bb99a4d784d28abed0c4dcc03fc03 and project c0890368fe814dd5b4370275a3d0420f. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:51:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a0f372cd-83ab-4655-8118-e659687eb932 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.608293 Nov 27 01:51:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 142/431] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Nov 27 01:51:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-dc5d582b-7fe8-46b0-8cd2-7f78dbc09887 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-dc5d582b-7fe8-46b0-8cd2-7f78dbc09887 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-dc5d582b-7fe8-46b0-8cd2-7f78dbc09887 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-dc5d582b-7fe8-46b0-8cd2-7f78dbc09887 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-dc5d582b-7fe8-46b0-8cd2-7f78dbc09887 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-dc5d582b-7fe8-46b0-8cd2-7f78dbc09887 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 200 len: 1272 microversion: 2.20 time: 0.069077 Nov 27 01:51:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 144/432] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:51:43 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 1272 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-2eea3b31-2744-42c2-8e73-f82df9b1ea81 req-285acf02-501f-4d1c-84a0-355d6d91e56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-plugged", "status": "completed", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2eea3b31-2744-42c2-8e73-f82df9b1ea81 req-285acf02-501f-4d1c-84a0-355d6d91e56b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2eea3b31-2744-42c2-8e73-f82df9b1ea81 req-285acf02-501f-4d1c-84a0-355d6d91e56b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2eea3b31-2744-42c2-8e73-f82df9b1ea81 req-285acf02-501f-4d1c-84a0-355d6d91e56b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-2eea3b31-2744-42c2-8e73-f82df9b1ea81 req-285acf02-501f-4d1c-84a0-355d6d91e56b service nova] Creating event network-vif-plugged:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:51:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-2eea3b31-2744-42c2-8e73-f82df9b1ea81 req-285acf02-501f-4d1c-84a0-355d6d91e56b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028515 Nov 27 01:51:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 143/433] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:43 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0e78256c-b12f-42d2-9ca5-a46ebcff3aed tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291" status: 200 len: 1689 microversion: 2.87 time: 0.331253 Nov 27 01:51:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 147/434] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:51:43 2023] GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291 => generated 1689 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-60ee1cba-d44e-417e-9000-2188d991680c req-d8c0b962-61aa-4262-821d-1dfc43bf2387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730c5e6f-ff73-40ee-9ccf-ac3ca2736e54", "name": "network-vif-deleted", "tag": "98696e52-6583-4c05-8984-c1554f2441ce"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-60ee1cba-d44e-417e-9000-2188d991680c req-d8c0b962-61aa-4262-821d-1dfc43bf2387 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-60ee1cba-d44e-417e-9000-2188d991680c req-d8c0b962-61aa-4262-821d-1dfc43bf2387 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-60ee1cba-d44e-417e-9000-2188d991680c req-d8c0b962-61aa-4262-821d-1dfc43bf2387 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-60ee1cba-d44e-417e-9000-2188d991680c req-d8c0b962-61aa-4262-821d-1dfc43bf2387 service nova] Creating event network-vif-deleted:98696e52-6583-4c05-8984-c1554f2441ce for instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 on user Nov 27 01:51:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-60ee1cba-d44e-417e-9000-2188d991680c req-d8c0b962-61aa-4262-821d-1dfc43bf2387 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029334 Nov 27 01:51:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 145/435] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:45 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6210614c-3e3b-46b4-bf04-f68cc9e7e577 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044069 Nov 27 01:51:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 144/436] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:51:45 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:45 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] HTTP exception thrown: Instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee is not attached to volume 8331a8bc-fffc-451e-9717-cc19d2f81bc5 Nov 27 01:51:45 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Returning 404 to user: Instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee is not attached to volume 8331a8bc-fffc-451e-9717-cc19d2f81bc5 {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:51:45 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a8056bf9-8b9c-4788-bf5c-de6ca1d771ed tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments/8331a8bc-fffc-451e-9717-cc19d2f81bc5" status: 404 len: 154 microversion: 2.1 time: 0.098871 Nov 27 01:51:45 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 148/437] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:51:45 2023] DELETE /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee/os-volume_attachments/8331a8bc-fffc-451e-9717-cc19d2f81bc5 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:51:45 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6afe819b-4086-42e8-9c87-fdd40923fec1 req-d592a723-47f4-4fc3-8edf-cc112d846689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6afe819b-4086-42e8-9c87-fdd40923fec1 req-d592a723-47f4-4fc3-8edf-cc112d846689 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6afe819b-4086-42e8-9c87-fdd40923fec1 req-d592a723-47f4-4fc3-8edf-cc112d846689 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6afe819b-4086-42e8-9c87-fdd40923fec1 req-d592a723-47f4-4fc3-8edf-cc112d846689 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:46 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6afe819b-4086-42e8-9c87-fdd40923fec1 req-d592a723-47f4-4fc3-8edf-cc112d846689 service nova] Creating event network-changed:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:51:46 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6afe819b-4086-42e8-9c87-fdd40923fec1 req-d592a723-47f4-4fc3-8edf-cc112d846689 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031721 Nov 27 01:51:46 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 146/438] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:47 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsV293TestJSON-server-807422776", "imageRef": "", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "b2e07325-1697-4e45-a630-759b44e4d0c2"}], "security_groups": [{"name": "tempest-securitygroup--203547594"}], "key_name": "tempest-keypair-1905395609", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b1a607cc-cd72-4b80-861d-73894a94f491", "source_type": "volume", "destination_type": "volume", "boot_index": 0, ": true}]}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:47 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-5e7b531a-ead0-4e97-bfa4-a439a2f3494e req-cfcb8875-8250-4767-88f8-37b10e1582ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-plugged", "status": "completed", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5e7b531a-ead0-4e97-bfa4-a439a2f3494e req-cfcb8875-8250-4767-88f8-37b10e1582ec service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5e7b531a-ead0-4e97-bfa4-a439a2f3494e req-cfcb8875-8250-4767-88f8-37b10e1582ec service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5e7b531a-ead0-4e97-bfa4-a439a2f3494e req-cfcb8875-8250-4767-88f8-37b10e1582ec service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:47 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-5e7b531a-ead0-4e97-bfa4-a439a2f3494e req-cfcb8875-8250-4767-88f8-37b10e1582ec service nova] Creating event network-vif-plugged:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:51:47 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-5e7b531a-ead0-4e97-bfa4-a439a2f3494e req-cfcb8875-8250-4767-88f8-37b10e1582ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052532 Nov 27 01:51:47 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 149/439] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:47 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] validate_networks() for [('b2e07325-1697-4e45-a630-759b44e4d0c2', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Getting quotas for project 9364a4c1bedd4dc68e97240fee6eba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Getting quotas for user 18ba391d043d4c798e2046791cf1941d and project 9364a4c1bedd4dc68e97240fee6eba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1a607cc-cd72-4b80-861d-73894a94f491',volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:51:48 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-e2033459-db06-4c65-83b5-bce773bed0b0 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.93 time: 0.702381 Nov 27 01:51:48 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 145/440] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Nov 27 01:51:47 2023] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:51:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4cc184e6-ed74-44cf-8e52-7db0c5378f10 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:48 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4cc184e6-ed74-44cf-8e52-7db0c5378f10 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:48 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-4cc184e6-ed74-44cf-8e52-7db0c5378f10 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:48 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-4cc184e6-ed74-44cf-8e52-7db0c5378f10 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:48 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-4cc184e6-ed74-44cf-8e52-7db0c5378f10 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4cc184e6-ed74-44cf-8e52-7db0c5378f10 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 200 len: 1332 microversion: 2.93 time: 0.084641 Nov 27 01:51:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 147/441] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:51:48 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:48 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:51:48 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d84b26dc-8bcf-4a9a-b121-1028e89e806b tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee" status: 204 len: 0 microversion: 2.1 time: 0.113875 Nov 27 01:51:48 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 150/442] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:51:48 2023] DELETE /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:49 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-e9170d25-27a3-4c16-8bde-fef8368f5ebc req-d9bcddb2-8188-4432-ba80-9314de736888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-unplugged", "status": "completed", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e9170d25-27a3-4c16-8bde-fef8368f5ebc req-d9bcddb2-8188-4432-ba80-9314de736888 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e9170d25-27a3-4c16-8bde-fef8368f5ebc req-d9bcddb2-8188-4432-ba80-9314de736888 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e9170d25-27a3-4c16-8bde-fef8368f5ebc req-d9bcddb2-8188-4432-ba80-9314de736888 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:49 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-e9170d25-27a3-4c16-8bde-fef8368f5ebc req-d9bcddb2-8188-4432-ba80-9314de736888 service nova] Creating event network-vif-unplugged:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:51:49 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-e9170d25-27a3-4c16-8bde-fef8368f5ebc req-d9bcddb2-8188-4432-ba80-9314de736888 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034984 Nov 27 01:51:49 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 148/443] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:51:49 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61091e519f55480db63568e194c5b3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed38a15ada7a48a9b490cfef0cc09f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-094eb560-383b-44cf-89cb-32da00a4460d tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee" status: 200 len: 1700 microversion: 2.1 time: 0.395713 Nov 27 01:51:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 146/444] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:48 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee => generated 1700 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:49 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-560368ab-7c6e-4c1a-be5a-770a4bedd59e req-c381d548-3aa2-464e-b8c5-8fd1e24971ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-plugged", "status": "completed", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-560368ab-7c6e-4c1a-be5a-770a4bedd59e req-c381d548-3aa2-464e-b8c5-8fd1e24971ec service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-560368ab-7c6e-4c1a-be5a-770a4bedd59e req-c381d548-3aa2-464e-b8c5-8fd1e24971ec service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-560368ab-7c6e-4c1a-be5a-770a4bedd59e req-c381d548-3aa2-464e-b8c5-8fd1e24971ec service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:49 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-560368ab-7c6e-4c1a-be5a-770a4bedd59e req-c381d548-3aa2-464e-b8c5-8fd1e24971ec service nova] Creating event network-vif-plugged:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:51:49 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-560368ab-7c6e-4c1a-be5a-770a4bedd59e req-c381d548-3aa2-464e-b8c5-8fd1e24971ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032389 Nov 27 01:51:49 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 151/445] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:51 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-plugged", "status": "completed", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}, {"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-plugged", "status": "completed", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}, {"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-plugged", "status": "completed", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}, {"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-unplugged", "status": "completed", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}, {"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-plugged", "status": "completed", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:51 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:51 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:51 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:51 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Creating event network-vif-plugged:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:51:51 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Creating event network-vif-plugged:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:51:51 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Creating event network-vif-plugged:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:51:51 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Creating event network-vif-unplugged:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:51:51 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] Creating event network-vif-plugged:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:51:51 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-0cfcc0a1-b3bc-4d6c-a987-bfc5f5154af5 req-5e4769e1-e0bf-4ef2-bc30-ec6ef6a41bc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.036091 Nov 27 01:51:51 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 147/446] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:51 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:51 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3f91299c-aa58-45ec-b2b6-b886327bd68a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 200 len: 1501 microversion: 2.1 time: 0.239298 Nov 27 01:51:51 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 149/447] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:51 2023] GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:51 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d74d4817-a692-4766-a95a-52c9601e19e7 req-8f6499c6-14c7-4c6b-bf82-fca266d96ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee", "name": "network-vif-deleted", "tag": "abe02340-2488-4467-b38b-106f992c1ecb"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d74d4817-a692-4766-a95a-52c9601e19e7 req-8f6499c6-14c7-4c6b-bf82-fca266d96ba6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d74d4817-a692-4766-a95a-52c9601e19e7 req-8f6499c6-14c7-4c6b-bf82-fca266d96ba6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d74d4817-a692-4766-a95a-52c9601e19e7 req-8f6499c6-14c7-4c6b-bf82-fca266d96ba6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:51 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d74d4817-a692-4766-a95a-52c9601e19e7 req-8f6499c6-14c7-4c6b-bf82-fca266d96ba6 service nova] Creating event network-vif-deleted:abe02340-2488-4467-b38b-106f992c1ecb for instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee on user Nov 27 01:51:51 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d74d4817-a692-4766-a95a-52c9601e19e7 req-8f6499c6-14c7-4c6b-bf82-fca266d96ba6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064495 Nov 27 01:51:51 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 152/448] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-a6024be6-c55d-42b9-a4f3-adc5c02b7275 req-149086ef-8d5e-4fb5-b63c-848b9ef58563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a6024be6-c55d-42b9-a4f3-adc5c02b7275 req-149086ef-8d5e-4fb5-b63c-848b9ef58563 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a6024be6-c55d-42b9-a4f3-adc5c02b7275 req-149086ef-8d5e-4fb5-b63c-848b9ef58563 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a6024be6-c55d-42b9-a4f3-adc5c02b7275 req-149086ef-8d5e-4fb5-b63c-848b9ef58563 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-a6024be6-c55d-42b9-a4f3-adc5c02b7275 req-149086ef-8d5e-4fb5-b63c-848b9ef58563 service nova] Creating event network-changed:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:51:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-a6024be6-c55d-42b9-a4f3-adc5c02b7275 req-149086ef-8d5e-4fb5-b63c-848b9ef58563 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033077 Nov 27 01:51:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 148/449] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:57 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b2d9a7b1-b2cf-4908-b731-325209a4a0ff tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045901 Nov 27 01:51:57 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 150/450] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:51:57 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:51:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:57 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e4d2b529-ffa2-4352-9aef-dbab93becbef tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046127 Nov 27 01:51:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 153/451] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:51:57 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:57 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:51:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-57ef2c9b-5d75-444d-8c8f-31a4f566d415 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4" status: 204 len: 0 microversion: 2.1 time: 0.113139 Nov 27 01:51:57 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 149/452] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:51:57 2023] DELETE /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f516a04e9548be9fdfde99560a2853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be6c26710e74c5388a4bde76dc6c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-caacb03e-8a09-451d-bf9f-8eaba3d31f18 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4" status: 200 len: 1671 microversion: 2.1 time: 0.232910 Nov 27 01:51:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 151/453] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:57 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-8001f2c1-58fb-4373-9e73-586cb6207b78 req-b02a40a1-1380-4279-a9ef-6f8151750fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fa0915-0bc4-4fb9-9e41-e14d51e993b4", "name": "network-vif-unplugged", "status": "completed", "tag": "0e20ea14-2cac-46bc-849d-a97a3e033d3c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8001f2c1-58fb-4373-9e73-586cb6207b78 req-b02a40a1-1380-4279-a9ef-6f8151750fce service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8001f2c1-58fb-4373-9e73-586cb6207b78 req-b02a40a1-1380-4279-a9ef-6f8151750fce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8001f2c1-58fb-4373-9e73-586cb6207b78 req-b02a40a1-1380-4279-a9ef-6f8151750fce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:58 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-8001f2c1-58fb-4373-9e73-586cb6207b78 req-b02a40a1-1380-4279-a9ef-6f8151750fce service nova] Creating event network-vif-unplugged:0e20ea14-2cac-46bc-849d-a97a3e033d3c for instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 on user Nov 27 01:51:58 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-8001f2c1-58fb-4373-9e73-586cb6207b78 req-b02a40a1-1380-4279-a9ef-6f8151750fce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048079 Nov 27 01:51:58 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 154/454] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:51:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=16 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-1292e182-2c4f-4d0b-9054-e3f74ceb04fa tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-491228832", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "90ee5c23-b10e-4785-b18a-9db7939564b3", "destination_type": "local"}, {"source_type": "volume", "uuid": "db40f2fc-37f6-4010-94e4-da06a1ef7496", "destination_type": "invalid"}], "networks": [{"uuid": "5787a76f-5250-487c-9397-6a4bfd68e364"}]}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-1292e182-2c4f-4d0b-9054-e3f74ceb04fa tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:51:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-1292e182-2c4f-4d0b-9054-e3f74ceb04fa tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009920 Nov 27 01:51:58 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 150/455] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:51:58 2023] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:58 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:51:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-437608ea-4b4a-46e5-ade8-cab391454c22 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 200 len: 1492 microversion: 2.1 time: 0.212040 Nov 27 01:51:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 152/456] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:51:58 2023] GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 1492 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:51:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-93e71bde-d5f3-4cf7-a29a-2b0094bc2b48 req-27451cb7-bd5e-47d8-86bc-045d92720a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fa0915-0bc4-4fb9-9e41-e14d51e993b4", "name": "network-vif-deleted", "tag": "0e20ea14-2cac-46bc-849d-a97a3e033d3c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:51:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-93e71bde-d5f3-4cf7-a29a-2b0094bc2b48 req-27451cb7-bd5e-47d8-86bc-045d92720a4d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:51:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-93e71bde-d5f3-4cf7-a29a-2b0094bc2b48 req-27451cb7-bd5e-47d8-86bc-045d92720a4d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:51:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-93e71bde-d5f3-4cf7-a29a-2b0094bc2b48 req-27451cb7-bd5e-47d8-86bc-045d92720a4d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:51:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-93e71bde-d5f3-4cf7-a29a-2b0094bc2b48 req-27451cb7-bd5e-47d8-86bc-045d92720a4d service nova] Creating event network-vif-deleted:0e20ea14-2cac-46bc-849d-a97a3e033d3c for instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 on user Nov 27 01:51:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-93e71bde-d5f3-4cf7-a29a-2b0094bc2b48 req-27451cb7-bd5e-47d8-86bc-045d92720a4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029945 Nov 27 01:51:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 155/457] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:51:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-7a7fc8ee-4f6a-4d4a-bab1-46a5ee2414cc req-e29c31c5-0573-4e1d-a845-5cb1c0943690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fa0915-0bc4-4fb9-9e41-e14d51e993b4", "name": "network-vif-plugged", "status": "completed", "tag": "0e20ea14-2cac-46bc-849d-a97a3e033d3c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a7fc8ee-4f6a-4d4a-bab1-46a5ee2414cc req-e29c31c5-0573-4e1d-a845-5cb1c0943690 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a7fc8ee-4f6a-4d4a-bab1-46a5ee2414cc req-e29c31c5-0573-4e1d-a845-5cb1c0943690 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a7fc8ee-4f6a-4d4a-bab1-46a5ee2414cc req-e29c31c5-0573-4e1d-a845-5cb1c0943690 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7a7fc8ee-4f6a-4d4a-bab1-46a5ee2414cc req-e29c31c5-0573-4e1d-a845-5cb1c0943690 service nova] Creating event network-vif-plugged:0e20ea14-2cac-46bc-849d-a97a3e033d3c for instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 on user Nov 27 01:52:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-7a7fc8ee-4f6a-4d4a-bab1-46a5ee2414cc req-e29c31c5-0573-4e1d-a845-5cb1c0943690 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029876 Nov 27 01:52:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 151/458] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-bcfad949-b5f8-4d92-b4e1-840d036cf472 req-9d2430a6-db30-453d-a0f0-2ef40c46c4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-plugged", "status": "completed", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}, {"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-plugged", "status": "completed", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bcfad949-b5f8-4d92-b4e1-840d036cf472 req-9d2430a6-db30-453d-a0f0-2ef40c46c4ce service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bcfad949-b5f8-4d92-b4e1-840d036cf472 req-9d2430a6-db30-453d-a0f0-2ef40c46c4ce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bcfad949-b5f8-4d92-b4e1-840d036cf472 req-9d2430a6-db30-453d-a0f0-2ef40c46c4ce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-bcfad949-b5f8-4d92-b4e1-840d036cf472 req-9d2430a6-db30-453d-a0f0-2ef40c46c4ce service nova] Creating event network-vif-plugged:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:52:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-bcfad949-b5f8-4d92-b4e1-840d036cf472 req-9d2430a6-db30-453d-a0f0-2ef40c46c4ce service nova] Creating event network-vif-plugged:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:52:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-bcfad949-b5f8-4d92-b4e1-840d036cf472 req-9d2430a6-db30-453d-a0f0-2ef40c46c4ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031469 Nov 27 01:52:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 156/459] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:02 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-fe2710bb-6b44-4e51-b2ac-868f872a9d5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 200 len: 1725 microversion: 2.1 time: 0.218335 Nov 27 01:52:02 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 153/460] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:02 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:02 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0a71f603-c17c-44c6-b1d6-883524a390bb tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1661 microversion: 2.1 time: 0.241372 Nov 27 01:52:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 152/461] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:02 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1661 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:15 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-7bfd0d90-4150-49fb-8c79-0608c4d6321d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1531 microversion: 2.1 time: 0.216077 Nov 27 01:52:15 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 157/462] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:14 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1531 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Searching by: {'deleted': False, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881'} {{(pid=65192) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=56 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:15 user devstack@n-api.service[65192]: DEBUG nova.compute.multi_cell_list [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65192) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 01:52:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-bc4991a8-0948-486d-84c0-ad581a9350b9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.070950 Nov 27 01:52:15 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 154/463] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Nov 27 01:52:15 2023] GET /compute/v2.1/servers => generated 341 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:15 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-fd1984ab-dda3-4821-87c3-c0b9fd27c465 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1531 microversion: 2.1 time: 0.160996 Nov 27 01:52:15 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 153/464] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:15 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1531 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dea9692-0970-4361-ab41-24960a46298a"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:18 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-97ec787c-5686-4c27-a1cb-c96fd61a1567 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303811 Nov 27 01:52:18 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 158/465] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:52:18 2023] POST /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:29 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] HTTP exception thrown: Instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 could not be found. Nov 27 01:52:29 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Returning 404 to user: Instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:29 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7348e406-7cf3-4afd-87d8-45b8ecdcc33c tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26" status: 404 len: 111 microversion: 2.1 time: 0.032035 Nov 27 01:52:29 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 155/466] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:29 2023] GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] HTTP exception thrown: Instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 could not be found. Nov 27 01:52:29 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Returning 404 to user: Instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-89575544-6855-43f7-bcf8-cf6891d748e1 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031981 Nov 27 01:52:29 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 154/467] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:52:29 2023] GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:30 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e446ee04-f539-469f-bc3b-318c1fa43c24 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1577 microversion: 2.1 time: 0.203447 Nov 27 01:52:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 159/468] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:30 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] [instance: 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] HTTP exception thrown: Instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 could not be found. Nov 27 01:52:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Returning 404 to user: Instance 730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-0581bed4-532a-4ac8-a316-92ec5bdd7e0d tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54" status: 404 len: 111 microversion: 2.1 time: 0.029378 Nov 27 01:52:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 156/469] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:31 2023] GET /compute/v2.1/servers/730c5e6f-ff73-40ee-9ccf-ac3ca2736e54 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:52:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ae26cdb7-e390-4783-b0dd-b6a0ebfc1d23 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] Calling method '.version_select at 0x7f364b3f3010>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ae26cdb7-e390-4783-b0dd-b6a0ebfc1d23 tempest-ServerStableDeviceRescueTest-1649609053 tempest-ServerStableDeviceRescueTest-1649609053-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158525946" status: 202 len: 0 microversion: 2.1 time: 0.022062 Nov 27 01:52:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 155/470] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 01:52:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158525946 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:52:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d5823ec5-4f8b-41dd-bf6c-cc1445a70a43 req-435b3416-c236-4fed-a1ad-0c032c2685af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d5823ec5-4f8b-41dd-bf6c-cc1445a70a43 req-435b3416-c236-4fed-a1ad-0c032c2685af service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d5823ec5-4f8b-41dd-bf6c-cc1445a70a43 req-435b3416-c236-4fed-a1ad-0c032c2685af service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d5823ec5-4f8b-41dd-bf6c-cc1445a70a43 req-435b3416-c236-4fed-a1ad-0c032c2685af service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d5823ec5-4f8b-41dd-bf6c-cc1445a70a43 req-435b3416-c236-4fed-a1ad-0c032c2685af service nova] Creating event network-changed:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d5823ec5-4f8b-41dd-bf6c-cc1445a70a43 req-435b3416-c236-4fed-a1ad-0c032c2685af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063145 Nov 27 01:52:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 160/471] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] HTTP exception thrown: Instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 could not be found. Nov 27 01:52:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Returning 404 to user: Instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-f59a4a18-7d6a-4b8f-acde-9b0bafb89809 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26" status: 404 len: 111 microversion: 2.1 time: 0.027963 Nov 27 01:52:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 157/472] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:52:33 2023] DELETE /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] [instance: 99d94162-bb03-4c5c-98c7-0c5cfdb6de26] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] HTTP exception thrown: Instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 could not be found. Nov 27 01:52:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] Returning 404 to user: Instance 99d94162-bb03-4c5c-98c7-0c5cfdb6de26 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-97d1f0c1-b12f-4d8e-a3ce-525aa28ed947 tempest-DeleteServersTestJSON-253007487 tempest-DeleteServersTestJSON-253007487-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26" status: 404 len: 111 microversion: 2.1 time: 0.034887 Nov 27 01:52:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 156/473] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:33 2023] GET /compute/v2.1/servers/99d94162-bb03-4c5c-98c7-0c5cfdb6de26 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:33 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4a819aa0-d1af-445a-ba01-9c03be74215e tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 200 len: 1584 microversion: 2.20 time: 0.404474 Nov 27 01:52:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 161/474] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:52:33 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 1584 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:52:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-259404659"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:34 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:34 user devstack@n-api.service[65192]: INFO nova.network.security_group_api [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Adding security group 40a2202e-e563-4070-b17a-0cdf9bf5cfca to port 6a62e37b-159a-4d5e-b3d6-746fc971ca4e Nov 27 01:52:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a1e73b15-219c-4423-b4c4-98278fd8069d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/action" status: 202 len: 0 microversion: 2.1 time: 1.020920 Nov 27 01:52:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 158/475] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:52:34 2023] POST /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/action => generated 0 bytes in 1023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:52:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-c9d1d138-0def-408c-89e2-f53eb1ea7551 req-97cec3dc-8b79-42e3-9717-4868bcc7d222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:35 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c9d1d138-0def-408c-89e2-f53eb1ea7551 req-97cec3dc-8b79-42e3-9717-4868bcc7d222 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c9d1d138-0def-408c-89e2-f53eb1ea7551 req-97cec3dc-8b79-42e3-9717-4868bcc7d222 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c9d1d138-0def-408c-89e2-f53eb1ea7551 req-97cec3dc-8b79-42e3-9717-4868bcc7d222 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-c9d1d138-0def-408c-89e2-f53eb1ea7551 req-97cec3dc-8b79-42e3-9717-4868bcc7d222 service nova] Creating event network-changed:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-c9d1d138-0def-408c-89e2-f53eb1ea7551 req-97cec3dc-8b79-42e3-9717-4868bcc7d222 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032368 Nov 27 01:52:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 157/476] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:36 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:36 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-99da312b-2539-43e3-ac1b-32d20b544be1 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1742 microversion: 2.1 time: 0.681899 Nov 27 01:52:36 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 162/477] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:35 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1742 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:38 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:38 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] [instance: dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] HTTP exception thrown: Instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee could not be found. Nov 27 01:52:39 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Returning 404 to user: Instance dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-bd3aeb73-6f9e-4a14-87ad-f9027d6bf176 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee" status: 404 len: 111 microversion: 2.1 time: 0.033192 Nov 27 01:52:39 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 158/478] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:39 2023] GET /compute/v2.1/servers/dcb7aaa0-c3b5-44e9-9dd0-7fb661c035ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:52:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ca251f42-dd76-4ee6-a877-8db5f7da0c03 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] Calling method '.version_select at 0x7f364b2301f0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ca251f42-dd76-4ee6-a877-8db5f7da0c03 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119 tempest-TestServerVolumeAttachScenarioOldVersion-1511158119-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-342771245" status: 202 len: 0 microversion: 2.1 time: 0.028608 Nov 27 01:52:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 163/479] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 01:52:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-342771245 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:52:39 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:39 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:39 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d14976ee-e5d6-4a36-82c4-2c2f87eac2cf tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 200 len: 1719 microversion: 2.93 time: 0.857703 Nov 27 01:52:39 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 159/480] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:52:38 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 1719 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:52:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:40 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-972d5c88-3229-47ff-94c2-2c784a58a239 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/action" status: 202 len: 0 microversion: 2.1 time: 0.098792 Nov 27 01:52:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 159/481] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:52:40 2023] POST /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:40 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c2416a28-f788-464b-9b5b-c450f1cd6b06 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1744 microversion: 2.1 time: 0.240090 Nov 27 01:52:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 164/482] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:40 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1744 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-064bf2ac-5125-4098-80f9-030379b0ecda req-3a736a6e-3fe9-47e8-8f6b-c3298fe120c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-unplugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-064bf2ac-5125-4098-80f9-030379b0ecda req-3a736a6e-3fe9-47e8-8f6b-c3298fe120c0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-064bf2ac-5125-4098-80f9-030379b0ecda req-3a736a6e-3fe9-47e8-8f6b-c3298fe120c0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-064bf2ac-5125-4098-80f9-030379b0ecda req-3a736a6e-3fe9-47e8-8f6b-c3298fe120c0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-064bf2ac-5125-4098-80f9-030379b0ecda req-3a736a6e-3fe9-47e8-8f6b-c3298fe120c0 service nova] Creating event network-vif-unplugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-064bf2ac-5125-4098-80f9-030379b0ecda req-3a736a6e-3fe9-47e8-8f6b-c3298fe120c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041598 Nov 27 01:52:41 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 160/483] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}, {"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}, {"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}, {"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-unplugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] Creating event network-vif-unplugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-7b71e22d-43f3-4cfa-b5a0-4f45869d4bca req-ddfe5189-2f4a-4fe0-a0c5-2cc0133b164a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.036649 Nov 27 01:52:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 160/484] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:43 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-501814776", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "0674729f-c03e-4bfb-bfbe-32ac4c167bcf"}]}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] validate_networks() for [('0674729f-c03e-4bfb-bfbe-32ac4c167bcf', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Getting quotas for project b168d75a030e425886b18204a7173843. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Getting quotas for user 357d7d579c284bcd836dd8075476d5ed and project b168d75a030e425886b18204a7173843. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:52:44 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:52:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-9c59d586-0c0a-43f3-a12e-b3485beb53b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.555632 Nov 27 01:52:44 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 165/485] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Nov 27 01:52:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:52:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-02ee3ffe-ef86-4679-96f9-86911ffbce8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:44 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-02ee3ffe-ef86-4679-96f9-86911ffbce8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:44 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-02ee3ffe-ef86-4679-96f9-86911ffbce8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:44 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-02ee3ffe-ef86-4679-96f9-86911ffbce8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:44 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-02ee3ffe-ef86-4679-96f9-86911ffbce8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-02ee3ffe-ef86-4679-96f9-86911ffbce8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 200 len: 1394 microversion: 2.87 time: 0.079581 Nov 27 01:52:44 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 161/486] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:52:44 2023] GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 1394 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:52:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-9c185786-2657-4582-a433-83077d2b4085 req-2832dbe4-51be-4602-b636-5ac275181c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9c185786-2657-4582-a433-83077d2b4085 req-2832dbe4-51be-4602-b636-5ac275181c0f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9c185786-2657-4582-a433-83077d2b4085 req-2832dbe4-51be-4602-b636-5ac275181c0f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9c185786-2657-4582-a433-83077d2b4085 req-2832dbe4-51be-4602-b636-5ac275181c0f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9c185786-2657-4582-a433-83077d2b4085 req-2832dbe4-51be-4602-b636-5ac275181c0f service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-9c185786-2657-4582-a433-83077d2b4085 req-2832dbe4-51be-4602-b636-5ac275181c0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043650 Nov 27 01:52:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 161/487] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:46 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-548cf81b-2850-4ac5-b044-e63d1fca5310 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Action: 'create', calling method: .version_select at 0x7f364b2315a0>, body: {"keypair": {"name": "tempest-keypair-1052011216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1FKdZbaJGLFcYjk42kPUlMRwkRHhXvJ14c/mD50NMbM1AJCPEk/cWsscUZtRmCMO3gFSh3C7ngsCKDMgiRPWejvP1n9WBAy2afubGneEE1x447yVM3pbyLi+w6AbUmJA=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:46 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-548cf81b-2850-4ac5-b044-e63d1fca5310 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Getting quotas for project c7a5273d2eb24e2598a4e7d6dc2a4d5c. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:52:46 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-548cf81b-2850-4ac5-b044-e63d1fca5310 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Getting quotas for user f4303689d56b490b9a71fc41cb1346bb and project c7a5273d2eb24e2598a4e7d6dc2a4d5c. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:52:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-548cf81b-2850-4ac5-b044-e63d1fca5310 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.262962 Nov 27 01:52:46 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 166/488] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:52:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:47 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-5d120c3a-5b9e-4db3-a86b-3b3f38d5fe22 req-c601e2d0-de4e-44db-8200-4cdecf0f1919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}, {"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5d120c3a-5b9e-4db3-a86b-3b3f38d5fe22 req-c601e2d0-de4e-44db-8200-4cdecf0f1919 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5d120c3a-5b9e-4db3-a86b-3b3f38d5fe22 req-c601e2d0-de4e-44db-8200-4cdecf0f1919 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5d120c3a-5b9e-4db3-a86b-3b3f38d5fe22 req-c601e2d0-de4e-44db-8200-4cdecf0f1919 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-5d120c3a-5b9e-4db3-a86b-3b3f38d5fe22 req-c601e2d0-de4e-44db-8200-4cdecf0f1919 service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-5d120c3a-5b9e-4db3-a86b-3b3f38d5fe22 req-c601e2d0-de4e-44db-8200-4cdecf0f1919 service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:52:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-5d120c3a-5b9e-4db3-a86b-3b3f38d5fe22 req-c601e2d0-de4e-44db-8200-4cdecf0f1919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039622 Nov 27 01:52:47 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 162/489] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:48 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] HTTP exception thrown: Instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 could not be found. Nov 27 01:52:48 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Returning 404 to user: Instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:48 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-21eb45ea-81d2-4d70-9837-d60eb23c91c9 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4" status: 404 len: 111 microversion: 2.1 time: 0.033476 Nov 27 01:52:48 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 162/490] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:48 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:52:48 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3ca920ce-fec7-4c54-8eeb-45702a4610f0 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '.version_select at 0x7f364b2304c0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:48 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3ca920ce-fec7-4c54-8eeb-45702a4610f0 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416531055" status: 202 len: 0 microversion: 2.1 time: 0.021611 Nov 27 01:52:48 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 167/491] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 01:52:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416531055 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:52:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-1da49107-2d9d-4ae7-9ace-d741a864d98c req-e1da5844-36ef-459a-90ee-d105dd8d3e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1da49107-2d9d-4ae7-9ace-d741a864d98c req-e1da5844-36ef-459a-90ee-d105dd8d3e1e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1da49107-2d9d-4ae7-9ace-d741a864d98c req-e1da5844-36ef-459a-90ee-d105dd8d3e1e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1da49107-2d9d-4ae7-9ace-d741a864d98c req-e1da5844-36ef-459a-90ee-d105dd8d3e1e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-1da49107-2d9d-4ae7-9ace-d741a864d98c req-e1da5844-36ef-459a-90ee-d105dd8d3e1e service nova] Creating event network-changed:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:52:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-1da49107-2d9d-4ae7-9ace-d741a864d98c req-e1da5844-36ef-459a-90ee-d105dd8d3e1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032402 Nov 27 01:52:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 163/492] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherB-server-1781701295", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "1631be99-daac-4058-857b-203398867b25"}], "security_groups": [{"name": "tempest-securitygroup--276751559"}], "key_name": "tempest-keypair-1052011216", "user_data": "}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] validate_networks() for [('1631be99-daac-4058-857b-203398867b25', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Getting quotas for project c7a5273d2eb24e2598a4e7d6dc2a4d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Getting quotas for user f4303689d56b490b9a71fc41cb1346bb and project c7a5273d2eb24e2598a4e7d6dc2a4d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:52:49 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:52:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c935a437-a61f-4e3d-bfaf-1848bd053973 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683633 Nov 27 01:52:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 163/493] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:52:49 2023] POST /compute/v2.1/servers => generated 406 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:52:49 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-be7440f8-e950-4da7-bb66-973e8e9bc68d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:49 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-be7440f8-e950-4da7-bb66-973e8e9bc68d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:50 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-be7440f8-e950-4da7-bb66-973e8e9bc68d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-be7440f8-e950-4da7-bb66-973e8e9bc68d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1233 microversion: 2.1 time: 0.090372 Nov 27 01:52:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 168/494] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:49 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:50 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c89f1486-6f4b-4ec5-8561-107494b8e107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'create', calling method: .version_select at 0x7f364b316a70>, body: {"keypair": {"name": "tempest-keypair-73200854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeS0ud25/JAXZt+h31As7g/yV6JM0c68nptMkWTzvsPy75zgWImBlH9DxubQ8SlaVVUuJUJWiCw78/ss1ZscOc3Uy0NVzFIckigq2dy/mqFygkHLy0FYTlbqDX6IQfqlw=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:50 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-c89f1486-6f4b-4ec5-8561-107494b8e107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Getting quotas for project 0f58fef2b9a44c91b1990c8b5b07212c. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:52:50 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-c89f1486-6f4b-4ec5-8561-107494b8e107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Getting quotas for user 98756aa16183475ca8113257bb08da2e and project 0f58fef2b9a44c91b1990c8b5b07212c. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:52:50 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c89f1486-6f4b-4ec5-8561-107494b8e107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.260480 Nov 27 01:52:50 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 164/495] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:52:50 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1876324306", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "33ae1cca-221f-47fd-aa00-c5bdfe094028"}], "security_groups": [{"name": "tempest-securitygroup--1726710559"}], "key_name": "tempest-keypair-73200854", "user_data": "}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:52 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] validate_networks() for [('33ae1cca-221f-47fd-aa00-c5bdfe094028', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Getting quotas for project 0f58fef2b9a44c91b1990c8b5b07212c. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Getting quotas for user 98756aa16183475ca8113257bb08da2e and project 0f58fef2b9a44c91b1990c8b5b07212c. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:52:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-758b16d5-8d9c-4aa8-baa5-36d3d25e25e6 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.627270 Nov 27 01:52:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 164/496] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:52:52 2023] POST /compute/v2.1/servers => generated 400 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:52:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-655cb3b1-e928-4927-bfe8-53efaaa6c42d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:53 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-655cb3b1-e928-4927-bfe8-53efaaa6c42d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-c6ab9035-e0b9-4715-bb03-a06ebf2ce80d req-ef4add35-38a7-4eff-a2c8-b172fef96931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:53 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-655cb3b1-e928-4927-bfe8-53efaaa6c42d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-655cb3b1-e928-4927-bfe8-53efaaa6c42d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1228 microversion: 2.1 time: 0.123613 Nov 27 01:52:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 169/497] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:53 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1228 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6ab9035-e0b9-4715-bb03-a06ebf2ce80d req-ef4add35-38a7-4eff-a2c8-b172fef96931 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6ab9035-e0b9-4715-bb03-a06ebf2ce80d req-ef4add35-38a7-4eff-a2c8-b172fef96931 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6ab9035-e0b9-4715-bb03-a06ebf2ce80d req-ef4add35-38a7-4eff-a2c8-b172fef96931 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c6ab9035-e0b9-4715-bb03-a06ebf2ce80d req-ef4add35-38a7-4eff-a2c8-b172fef96931 service nova] Creating event network-changed:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:52:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-c6ab9035-e0b9-4715-bb03-a06ebf2ce80d req-ef4add35-38a7-4eff-a2c8-b172fef96931 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043087 Nov 27 01:52:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 165/498] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] HTTP exception thrown: Instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 could not be found. Nov 27 01:52:54 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Returning 404 to user: Instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-72a9b02d-0156-4175-b136-42b1624937f4 tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4" status: 404 len: 111 microversion: 2.1 time: 0.038711 Nov 27 01:52:54 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 165/499] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:52:53 2023] DELETE /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] [instance: d7fa0915-0bc4-4fb9-9e41-e14d51e993b4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] HTTP exception thrown: Instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 could not be found. Nov 27 01:52:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] Returning 404 to user: Instance d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:52:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-fe91e500-1872-426f-b638-1e52f8fc847c tempest-AttachSCSIVolumeTestJSON-2025837570 tempest-AttachSCSIVolumeTestJSON-2025837570-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4" status: 404 len: 111 microversion: 2.1 time: 0.030068 Nov 27 01:52:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 170/500] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:54 2023] GET /compute/v2.1/servers/d7fa0915-0bc4-4fb9-9e41-e14d51e993b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:52:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-6c31eb7f-3858-4a33-bf1d-b483b8066d9a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'create', calling method: .version_select at 0x7f364b211630>, body: {"keypair": {"name": "tempest-keypair-825171087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDDOAEdBdKTljKm/Dzfr1R8D5Tw4Ws3Ikis2tWOf4qryBtgd22XFaTvT3y+fMjievtTKFPV9CsiPKUR5/HER6MAaTp2QsdtDA96M4yv1iGND0Yr89yS3G9SCwoXiaNTAA=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:54 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-6c31eb7f-3858-4a33-bf1d-b483b8066d9a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Getting quotas for project a953169393c9425985ef738e51b22868. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:52:54 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-6c31eb7f-3858-4a33-bf1d-b483b8066d9a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Getting quotas for user 44beb0a742a24c30a7e2004988809c51 and project a953169393c9425985ef738e51b22868. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:52:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-6c31eb7f-3858-4a33-bf1d-b483b8066d9a tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080451 Nov 27 01:52:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 166/501] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:52:54 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:55 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-3d4d625c-ccd4-41d7-8469-1046a52f4925 req-05e35b37-4c5f-44a2-8785-c4fd9bece866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3d4d625c-ccd4-41d7-8469-1046a52f4925 req-05e35b37-4c5f-44a2-8785-c4fd9bece866 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3d4d625c-ccd4-41d7-8469-1046a52f4925 req-05e35b37-4c5f-44a2-8785-c4fd9bece866 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3d4d625c-ccd4-41d7-8469-1046a52f4925 req-05e35b37-4c5f-44a2-8785-c4fd9bece866 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-3d4d625c-ccd4-41d7-8469-1046a52f4925 req-05e35b37-4c5f-44a2-8785-c4fd9bece866 service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:52:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-3d4d625c-ccd4-41d7-8469-1046a52f4925 req-05e35b37-4c5f-44a2-8785-c4fd9bece866 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039424 Nov 27 01:52:55 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 166/502] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:56 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-126165914", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "5626595d-0f21-42f3-b0cc-906b894ce10a"}], "security_groups": [{"name": "tempest-securitygroup--1680481782"}], "key_name": "tempest-keypair-825171087", "user_data": "}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:56 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:52:56 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] validate_networks() for [('5626595d-0f21-42f3-b0cc-906b894ce10a', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Getting quotas for project a953169393c9425985ef738e51b22868. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Getting quotas for user 44beb0a742a24c30a7e2004988809c51 and project a953169393c9425985ef738e51b22868. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:52:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b5334fed-3574-4c71-ab98-52f26567aa7c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.620318 Nov 27 01:52:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 171/503] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:52:56 2023] POST /compute/v2.1/servers => generated 407 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:52:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-8acd09d5-83cf-4992-a10a-55075ccad4ae req-a37ed6d2-6843-485a-8a6a-6707c5d146e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-cf76e451-68fe-486b-82ec-b42cfc53d3c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:52:57 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-cf76e451-68fe-486b-82ec-b42cfc53d3c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:52:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8acd09d5-83cf-4992-a10a-55075ccad4ae req-a37ed6d2-6843-485a-8a6a-6707c5d146e5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8acd09d5-83cf-4992-a10a-55075ccad4ae req-a37ed6d2-6843-485a-8a6a-6707c5d146e5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8acd09d5-83cf-4992-a10a-55075ccad4ae req-a37ed6d2-6843-485a-8a6a-6707c5d146e5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8acd09d5-83cf-4992-a10a-55075ccad4ae req-a37ed6d2-6843-485a-8a6a-6707c5d146e5 service nova] Creating event network-changed:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:52:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-8acd09d5-83cf-4992-a10a-55075ccad4ae req-a37ed6d2-6843-485a-8a6a-6707c5d146e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031120 Nov 27 01:52:57 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 167/504] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:52:57 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-cf76e451-68fe-486b-82ec-b42cfc53d3c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:52:57 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-cf76e451-68fe-486b-82ec-b42cfc53d3c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 200 len: 1236 microversion: 2.1 time: 0.147777 Nov 27 01:52:57 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 167/505] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:52:57 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 1236 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-243b21d0-2b5e-4e29-92ef-9dd85b3e3a19 req-f379dc8d-2ca9-4f8b-989c-9a03e75d2ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-243b21d0-2b5e-4e29-92ef-9dd85b3e3a19 req-f379dc8d-2ca9-4f8b-989c-9a03e75d2ae2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-243b21d0-2b5e-4e29-92ef-9dd85b3e3a19 req-f379dc8d-2ca9-4f8b-989c-9a03e75d2ae2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:52:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-243b21d0-2b5e-4e29-92ef-9dd85b3e3a19 req-f379dc8d-2ca9-4f8b-989c-9a03e75d2ae2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:52:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-243b21d0-2b5e-4e29-92ef-9dd85b3e3a19 req-f379dc8d-2ca9-4f8b-989c-9a03e75d2ae2 service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:52:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-243b21d0-2b5e-4e29-92ef-9dd85b3e3a19 req-f379dc8d-2ca9-4f8b-989c-9a03e75d2ae2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033886 Nov 27 01:52:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 172/506] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:52:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-188ac3c8-8333-4ef9-bd17-acd2899a1d5e req-04025e68-9d85-4970-ad51-1d3d979e3182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-188ac3c8-8333-4ef9-bd17-acd2899a1d5e req-04025e68-9d85-4970-ad51-1d3d979e3182 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-188ac3c8-8333-4ef9-bd17-acd2899a1d5e req-04025e68-9d85-4970-ad51-1d3d979e3182 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-188ac3c8-8333-4ef9-bd17-acd2899a1d5e req-04025e68-9d85-4970-ad51-1d3d979e3182 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-188ac3c8-8333-4ef9-bd17-acd2899a1d5e req-04025e68-9d85-4970-ad51-1d3d979e3182 service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:53:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-188ac3c8-8333-4ef9-bd17-acd2899a1d5e req-04025e68-9d85-4970-ad51-1d3d979e3182 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034819 Nov 27 01:53:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 168/507] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:01 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-800b1ee2-d94c-4f1e-9ff9-a0c71f47ce4e req-56c8dfb7-1c60-4918-aab0-b88dadea2893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-800b1ee2-d94c-4f1e-9ff9-a0c71f47ce4e req-56c8dfb7-1c60-4918-aab0-b88dadea2893 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-800b1ee2-d94c-4f1e-9ff9-a0c71f47ce4e req-56c8dfb7-1c60-4918-aab0-b88dadea2893 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-800b1ee2-d94c-4f1e-9ff9-a0c71f47ce4e req-56c8dfb7-1c60-4918-aab0-b88dadea2893 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-800b1ee2-d94c-4f1e-9ff9-a0c71f47ce4e req-56c8dfb7-1c60-4918-aab0-b88dadea2893 service nova] Creating event network-changed:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:53:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-800b1ee2-d94c-4f1e-9ff9-a0c71f47ce4e req-56c8dfb7-1c60-4918-aab0-b88dadea2893 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044578 Nov 27 01:53:01 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 168/508] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c9d82551-4e9c-47b5-924c-7bfea20301e1 req-0151aa8b-3bd0-4bd2-aae8-cf24e1b96756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9d82551-4e9c-47b5-924c-7bfea20301e1 req-0151aa8b-3bd0-4bd2-aae8-cf24e1b96756 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9d82551-4e9c-47b5-924c-7bfea20301e1 req-0151aa8b-3bd0-4bd2-aae8-cf24e1b96756 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c9d82551-4e9c-47b5-924c-7bfea20301e1 req-0151aa8b-3bd0-4bd2-aae8-cf24e1b96756 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-c9d82551-4e9c-47b5-924c-7bfea20301e1 req-0151aa8b-3bd0-4bd2-aae8-cf24e1b96756 service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:53:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c9d82551-4e9c-47b5-924c-7bfea20301e1 req-0151aa8b-3bd0-4bd2-aae8-cf24e1b96756 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082429 Nov 27 01:53:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 173/509] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=12 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:03 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lazy-loading 'services' on Instance uuid 6da3a108-b503-4e6a-a5c2-8ada0a20d145 {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:53:03 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-e0709844-aa5c-419b-8b15-383e31df5f3a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-volume_attachments/6b3c186f-bfd9-4dfd-b1a5-030820030dd1" status: 202 len: 0 microversion: 2.1 time: 0.209112 Nov 27 01:53:03 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 169/510] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:53:03 2023] DELETE /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-volume_attachments/6b3c186f-bfd9-4dfd-b1a5-030820030dd1 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:53:03 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:03 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-fbb19b6e-355b-45a3-893a-5a33888615a3 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124851 Nov 27 01:53:03 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 169/511] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:53:03 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:03 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-94f17bb2-aaba-4dab-9bd1-dcb9b42feaec req-e74ba41f-a5c7-47c6-b014-146287e5e631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-94f17bb2-aaba-4dab-9bd1-dcb9b42feaec req-e74ba41f-a5c7-47c6-b014-146287e5e631 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-94f17bb2-aaba-4dab-9bd1-dcb9b42feaec req-e74ba41f-a5c7-47c6-b014-146287e5e631 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-94f17bb2-aaba-4dab-9bd1-dcb9b42feaec req-e74ba41f-a5c7-47c6-b014-146287e5e631 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-94f17bb2-aaba-4dab-9bd1-dcb9b42feaec req-e74ba41f-a5c7-47c6-b014-146287e5e631 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:53:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-94f17bb2-aaba-4dab-9bd1-dcb9b42feaec req-e74ba41f-a5c7-47c6-b014-146287e5e631 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048892 Nov 27 01:53:03 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 174/512] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-8d40155c-1c6a-4538-b960-d01b11a96c0c req-abe0a292-525a-4bd6-af31-7963985b6380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8d40155c-1c6a-4538-b960-d01b11a96c0c req-abe0a292-525a-4bd6-af31-7963985b6380 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8d40155c-1c6a-4538-b960-d01b11a96c0c req-abe0a292-525a-4bd6-af31-7963985b6380 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8d40155c-1c6a-4538-b960-d01b11a96c0c req-abe0a292-525a-4bd6-af31-7963985b6380 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8d40155c-1c6a-4538-b960-d01b11a96c0c req-abe0a292-525a-4bd6-af31-7963985b6380 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:53:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-8d40155c-1c6a-4538-b960-d01b11a96c0c req-abe0a292-525a-4bd6-af31-7963985b6380 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040727 Nov 27 01:53:05 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 170/513] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:07 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-0426fdc5-6138-4baa-b00d-a1bd1167098b req-324b982c-ca6a-4681-be01-d4f10581ebc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:07 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=12 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0426fdc5-6138-4baa-b00d-a1bd1167098b req-324b982c-ca6a-4681-be01-d4f10581ebc6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0426fdc5-6138-4baa-b00d-a1bd1167098b req-324b982c-ca6a-4681-be01-d4f10581ebc6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0426fdc5-6138-4baa-b00d-a1bd1167098b req-324b982c-ca6a-4681-be01-d4f10581ebc6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-0426fdc5-6138-4baa-b00d-a1bd1167098b req-324b982c-ca6a-4681-be01-d4f10581ebc6 service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:53:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-0426fdc5-6138-4baa-b00d-a1bd1167098b req-324b982c-ca6a-4681-be01-d4f10581ebc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041141 Nov 27 01:53:07 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 170/514] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=20 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] HTTP exception thrown: Instance 98831619-1f75-41ad-a5f8-52a3f9055d53 could not be found. Nov 27 01:53:08 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Returning 404 to user: Instance 98831619-1f75-41ad-a5f8-52a3f9055d53 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:53:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b46f6d97-c10b-49ef-a524-2a2f349e9b02 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53" status: 404 len: 111 microversion: 2.1 time: 0.045877 Nov 27 01:53:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 175/515] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:53:08 2023] DELETE /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: 98831619-1f75-41ad-a5f8-52a3f9055d53] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] HTTP exception thrown: Instance 98831619-1f75-41ad-a5f8-52a3f9055d53 could not be found. Nov 27 01:53:08 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Returning 404 to user: Instance 98831619-1f75-41ad-a5f8-52a3f9055d53 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:53:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c538c8e0-9545-4ce5-ba46-3d9c574de890 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53" status: 404 len: 111 microversion: 2.1 time: 0.034369 Nov 27 01:53:08 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 171/516] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:08 2023] GET /compute/v2.1/servers/98831619-1f75-41ad-a5f8-52a3f9055d53 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 01:53:08 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:08 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:08 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:09 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:53:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-eaaa9ccb-e3ef-4592-b3ae-17b492402be0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 204 len: 0 microversion: 2.1 time: 0.237399 Nov 27 01:53:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 171/517] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:53:08 2023] DELETE /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-1d71241d-c524-463c-80a9-0467f8325510 req-db7c7cf4-05d6-4a69-8cf8-551128dd7a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c15d2a-ec55-45b2-8049-afe5e8bb1734", "name": "network-vif-unplugged", "status": "completed", "tag": "384c3362-9874-454f-a212-414f42323c17"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1d71241d-c524-463c-80a9-0467f8325510 req-db7c7cf4-05d6-4a69-8cf8-551128dd7a02 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1d71241d-c524-463c-80a9-0467f8325510 req-db7c7cf4-05d6-4a69-8cf8-551128dd7a02 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1d71241d-c524-463c-80a9-0467f8325510 req-db7c7cf4-05d6-4a69-8cf8-551128dd7a02 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-1d71241d-c524-463c-80a9-0467f8325510 req-db7c7cf4-05d6-4a69-8cf8-551128dd7a02 service nova] Creating event network-vif-unplugged:384c3362-9874-454f-a212-414f42323c17 for instance e4c15d2a-ec55-45b2-8049-afe5e8bb1734 on user Nov 27 01:53:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-1d71241d-c524-463c-80a9-0467f8325510 req-db7c7cf4-05d6-4a69-8cf8-551128dd7a02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100348 Nov 27 01:53:09 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 172/518] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-945634c6-29f8-4b5c-85c2-39cd655ef8ee req-a3c0b0a6-3841-4576-b9d8-db2f8d23589e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-945634c6-29f8-4b5c-85c2-39cd655ef8ee req-a3c0b0a6-3841-4576-b9d8-db2f8d23589e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-945634c6-29f8-4b5c-85c2-39cd655ef8ee req-a3c0b0a6-3841-4576-b9d8-db2f8d23589e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-945634c6-29f8-4b5c-85c2-39cd655ef8ee req-a3c0b0a6-3841-4576-b9d8-db2f8d23589e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-945634c6-29f8-4b5c-85c2-39cd655ef8ee req-a3c0b0a6-3841-4576-b9d8-db2f8d23589e service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:53:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-945634c6-29f8-4b5c-85c2-39cd655ef8ee req-a3c0b0a6-3841-4576-b9d8-db2f8d23589e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049256 Nov 27 01:53:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 172/519] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:09 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a32ce477e41df86f143a13989f498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61df2ba0c7ea44b8b96ee810e90c3611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ab65036c-eb92-47e3-8f36-c7a7780793b0 tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 200 len: 1498 microversion: 2.1 time: 0.517268 Nov 27 01:53:09 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 176/520] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:09 2023] GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 1498 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 01:53:11 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-ab7586d4-384f-4b79-a5d3-3456fbd19401 req-0f69c88b-49b8-456e-9508-336e32a236d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c15d2a-ec55-45b2-8049-afe5e8bb1734", "name": "network-vif-plugged", "status": "completed", "tag": "384c3362-9874-454f-a212-414f42323c17"}, {"server_uuid": "e4c15d2a-ec55-45b2-8049-afe5e8bb1734", "name": "network-vif-deleted", "tag": "384c3362-9874-454f-a212-414f42323c17"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ab7586d4-384f-4b79-a5d3-3456fbd19401 req-0f69c88b-49b8-456e-9508-336e32a236d4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ab7586d4-384f-4b79-a5d3-3456fbd19401 req-0f69c88b-49b8-456e-9508-336e32a236d4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ab7586d4-384f-4b79-a5d3-3456fbd19401 req-0f69c88b-49b8-456e-9508-336e32a236d4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-ab7586d4-384f-4b79-a5d3-3456fbd19401 req-0f69c88b-49b8-456e-9508-336e32a236d4 service nova] Creating event network-vif-plugged:384c3362-9874-454f-a212-414f42323c17 for instance e4c15d2a-ec55-45b2-8049-afe5e8bb1734 on user Nov 27 01:53:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-ab7586d4-384f-4b79-a5d3-3456fbd19401 req-0f69c88b-49b8-456e-9508-336e32a236d4 service nova] Creating event network-vif-deleted:384c3362-9874-454f-a212-414f42323c17 for instance e4c15d2a-ec55-45b2-8049-afe5e8bb1734 on user Nov 27 01:53:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-ab7586d4-384f-4b79-a5d3-3456fbd19401 req-0f69c88b-49b8-456e-9508-336e32a236d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035651 Nov 27 01:53:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 173/521] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-629569849", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "b1e04b36-d097-4233-8313-ac966643868b"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] validate_networks() for [('b1e04b36-d097-4233-8313-ac966643868b', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Getting quotas for project 3319924ef4a4429b8e19ba725f15fa75. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Getting quotas for user 579baf1092cb4cc58598f0e57ebbabee and project 3319924ef4a4429b8e19ba725f15fa75. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:53:19 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] [instance: fe37682d-ddd8-4ddf-8e0a-ead1af33ac81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:53:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-dca345c6-3071-423e-b7e5-0755f7a50c0c tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.594056 Nov 27 01:53:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 173/522] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:53:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:53:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5a781a8a-f09f-4ffc-8dd6-fae1cd7e1b56 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:19 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5a781a8a-f09f-4ffc-8dd6-fae1cd7e1b56 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] [instance: fe37682d-ddd8-4ddf-8e0a-ead1af33ac81] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:19 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:19 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-5a781a8a-f09f-4ffc-8dd6-fae1cd7e1b56 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579baf1092cb4cc58598f0e57ebbabee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3319924ef4a4429b8e19ba725f15fa75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5a781a8a-f09f-4ffc-8dd6-fae1cd7e1b56 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81" status: 200 len: 1205 microversion: 2.1 time: 0.082881 Nov 27 01:53:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 177/523] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:19 2023] GET /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 => generated 1205 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:53:22 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:22 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:22 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-5a305c84-abe5-430e-881a-a827890e11ca req-36d67dd4-66c2-42ed-8f3b-e2c9cb892a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe37682d-ddd8-4ddf-8e0a-ead1af33ac81", "tag": "18360711-d8e6-443f-a9b7-0116d2743ccd"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5a305c84-abe5-430e-881a-a827890e11ca req-36d67dd4-66c2-42ed-8f3b-e2c9cb892a3a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5a305c84-abe5-430e-881a-a827890e11ca req-36d67dd4-66c2-42ed-8f3b-e2c9cb892a3a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5a305c84-abe5-430e-881a-a827890e11ca req-36d67dd4-66c2-42ed-8f3b-e2c9cb892a3a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-5a305c84-abe5-430e-881a-a827890e11ca req-36d67dd4-66c2-42ed-8f3b-e2c9cb892a3a service nova] Creating event network-changed:18360711-d8e6-443f-a9b7-0116d2743ccd for instance fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 on user Nov 27 01:53:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-5a305c84-abe5-430e-881a-a827890e11ca req-36d67dd4-66c2-42ed-8f3b-e2c9cb892a3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036973 Nov 27 01:53:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 174/524] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:24 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-861c626e-89d8-48cf-ae1a-06ab73367b21 req-a76bcbbf-4439-4f88-aeb8-b65442097dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe37682d-ddd8-4ddf-8e0a-ead1af33ac81", "name": "network-vif-plugged", "status": "completed", "tag": "18360711-d8e6-443f-a9b7-0116d2743ccd"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-861c626e-89d8-48cf-ae1a-06ab73367b21 req-a76bcbbf-4439-4f88-aeb8-b65442097dc6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-861c626e-89d8-48cf-ae1a-06ab73367b21 req-a76bcbbf-4439-4f88-aeb8-b65442097dc6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-861c626e-89d8-48cf-ae1a-06ab73367b21 req-a76bcbbf-4439-4f88-aeb8-b65442097dc6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-861c626e-89d8-48cf-ae1a-06ab73367b21 req-a76bcbbf-4439-4f88-aeb8-b65442097dc6 service nova] Creating event network-vif-plugged:18360711-d8e6-443f-a9b7-0116d2743ccd for instance fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 on user Nov 27 01:53:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-861c626e-89d8-48cf-ae1a-06ab73367b21 req-a76bcbbf-4439-4f88-aeb8-b65442097dc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047067 Nov 27 01:53:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 174/525] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-77756c5f-cacf-4c29-9354-24120d6fab28 req-60e8514c-0931-49a1-92c1-adb6115e0c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe37682d-ddd8-4ddf-8e0a-ead1af33ac81", "name": "network-vif-plugged", "status": "completed", "tag": "18360711-d8e6-443f-a9b7-0116d2743ccd"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:26 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=46 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-77756c5f-cacf-4c29-9354-24120d6fab28 req-60e8514c-0931-49a1-92c1-adb6115e0c2a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-77756c5f-cacf-4c29-9354-24120d6fab28 req-60e8514c-0931-49a1-92c1-adb6115e0c2a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-77756c5f-cacf-4c29-9354-24120d6fab28 req-60e8514c-0931-49a1-92c1-adb6115e0c2a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-77756c5f-cacf-4c29-9354-24120d6fab28 req-60e8514c-0931-49a1-92c1-adb6115e0c2a service nova] Creating event network-vif-plugged:18360711-d8e6-443f-a9b7-0116d2743ccd for instance fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 on user Nov 27 01:53:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-77756c5f-cacf-4c29-9354-24120d6fab28 req-60e8514c-0931-49a1-92c1-adb6115e0c2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037594 Nov 27 01:53:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 178/526] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:30 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-98f30aa6-e6cf-4ba5-8eb4-020118dbf5e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1742 microversion: 2.1 time: 0.254712 Nov 27 01:53:30 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 175/527] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:30 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1742 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:33 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-245e9690-f14f-4858-bc4c-bf0e54e70067 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.142027 Nov 27 01:53:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 175/528] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Nov 27 01:53:33 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/os-interface => generated 282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:53:34 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-dfbb16e5-b7da-4dd5-9f00-d44ff89249be req-e60dae88-dcf1-43df-aa0d-6fe888e2d989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:34 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:53:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-dfbb16e5-b7da-4dd5-9f00-d44ff89249be req-e60dae88-dcf1-43df-aa0d-6fe888e2d989 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-dfbb16e5-b7da-4dd5-9f00-d44ff89249be req-e60dae88-dcf1-43df-aa0d-6fe888e2d989 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-dfbb16e5-b7da-4dd5-9f00-d44ff89249be req-e60dae88-dcf1-43df-aa0d-6fe888e2d989 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-dfbb16e5-b7da-4dd5-9f00-d44ff89249be req-e60dae88-dcf1-43df-aa0d-6fe888e2d989 service nova] Creating event network-changed:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-dfbb16e5-b7da-4dd5-9f00-d44ff89249be req-e60dae88-dcf1-43df-aa0d-6fe888e2d989 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032693 Nov 27 01:53:34 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 179/529] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:34 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-1d6e3ff9-71e9-4963-9b75-c667bac1df8c tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/ips" status: 200 len: 110 microversion: 2.20 time: 0.039100 Nov 27 01:53:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 176/530] 10.0.0.210 () {64 vars in 1366 bytes} [Mon Nov 27 01:53:34 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/ips => generated 110 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:34 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-f2e30ae7-14e4-463d-89d0-49ce63a021ea tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 200 len: 1768 microversion: 2.87 time: 0.207091 Nov 27 01:53:34 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 176/531] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:53:34 2023] GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 1768 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:37 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lazy-loading 'flavor' on Instance uuid 9cb4f4de-56ea-4821-b96b-4fc4a9493acc {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:53:38 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-05d48dae-056e-4b1d-bfde-e3a8d2c07b4a tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/action" status: 202 len: 0 microversion: 2.20 time: 0.906188 Nov 27 01:53:38 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 180/532] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 01:53:37 2023] POST /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:38 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:38 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3a438b11-cee1-4526-8c68-67257eb3ded3 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 200 len: 1709 microversion: 2.20 time: 0.209881 Nov 27 01:53:38 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 177/533] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:53:38 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 1709 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:53:38 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-1125c51a-0541-45c1-9d33-4cf880f525de req-c6d0a6f9-c606-439d-8ae3-e846cf2f4015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-unplugged", "status": "completed", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1125c51a-0541-45c1-9d33-4cf880f525de req-c6d0a6f9-c606-439d-8ae3-e846cf2f4015 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1125c51a-0541-45c1-9d33-4cf880f525de req-c6d0a6f9-c606-439d-8ae3-e846cf2f4015 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1125c51a-0541-45c1-9d33-4cf880f525de req-c6d0a6f9-c606-439d-8ae3-e846cf2f4015 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-1125c51a-0541-45c1-9d33-4cf880f525de req-c6d0a6f9-c606-439d-8ae3-e846cf2f4015 service nova] Creating event network-vif-unplugged:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:53:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-1125c51a-0541-45c1-9d33-4cf880f525de req-c6d0a6f9-c606-439d-8ae3-e846cf2f4015 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045654 Nov 27 01:53:38 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 177/534] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:39 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-95ebae14-111c-4e60-9f89-25ff22a47090 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee/os-interface" status: 200 len: 295 microversion: 2.93 time: 0.257249 Nov 27 01:53:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 181/535] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Nov 27 01:53:39 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee/os-interface => generated 295 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:40 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-98879e21-501d-46d7-859c-5f49f852887f tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1542 microversion: 2.1 time: 0.335625 Nov 27 01:53:40 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 178/536] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:40 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1542 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-41ccb9c3-c1d7-40b4-b7df-63fee0a4fee1 req-762b9228-22c6-48b7-a6f2-ac6ce2884f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-plugged", "status": "completed", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}, {"name": "network-changed", "server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-41ccb9c3-c1d7-40b4-b7df-63fee0a4fee1 req-762b9228-22c6-48b7-a6f2-ac6ce2884f45 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-41ccb9c3-c1d7-40b4-b7df-63fee0a4fee1 req-762b9228-22c6-48b7-a6f2-ac6ce2884f45 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-41ccb9c3-c1d7-40b4-b7df-63fee0a4fee1 req-762b9228-22c6-48b7-a6f2-ac6ce2884f45 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-41ccb9c3-c1d7-40b4-b7df-63fee0a4fee1 req-762b9228-22c6-48b7-a6f2-ac6ce2884f45 service nova] Creating event network-vif-plugged:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:53:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-41ccb9c3-c1d7-40b4-b7df-63fee0a4fee1 req-762b9228-22c6-48b7-a6f2-ac6ce2884f45 service nova] Creating event network-changed:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:53:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-41ccb9c3-c1d7-40b4-b7df-63fee0a4fee1 req-762b9228-22c6-48b7-a6f2-ac6ce2884f45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034300 Nov 27 01:53:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 182/537] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:40 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:40 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4b2701b5-f71a-456a-b45c-3a2d8e9618bd tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 200 len: 1719 microversion: 2.93 time: 0.231698 Nov 27 01:53:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 178/538] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:53:40 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsV293TestJSON-server-298693358", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Getting quotas for project 9364a4c1bedd4dc68e97240fee6eba62. Resources: dict_keys(['metadata_items']) {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Getting quotas for user 18ba391d043d4c798e2046791cf1941d and project 9364a4c1bedd4dc68e97240fee6eba62. Resources: dict_keys(['metadata_items']) {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:42 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:42 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:42 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-502057cc-25f4-4564-b2e8-9807fda60d9b tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee/action" status: 202 len: 2043 microversion: 2.93 time: 0.851275 Nov 27 01:53:42 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 179/539] 10.0.0.210 () {66 vars in 1397 bytes} [Mon Nov 27 01:53:41 2023] POST /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee/action => generated 2043 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 27 01:53:42 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ea1abb72-97d1-4183-972e-c7196d7332df tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ea1abb72-97d1-4183-972e-c7196d7332df tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 423 microversion: 2.93 time: 0.020591 Nov 27 01:53:42 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 183/540] 10.0.0.210 () {64 vars in 1249 bytes} [Mon Nov 27 01:53:42 2023] GET /compute/v2.1/flavors/1 => generated 423 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:42 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-8a70c658-7074-44d9-9b69-d49bb3a4c8be req-fcb7e770-73de-4922-bd8e-b69b7ec15584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-unplugged", "status": "completed", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8a70c658-7074-44d9-9b69-d49bb3a4c8be req-fcb7e770-73de-4922-bd8e-b69b7ec15584 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8a70c658-7074-44d9-9b69-d49bb3a4c8be req-fcb7e770-73de-4922-bd8e-b69b7ec15584 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8a70c658-7074-44d9-9b69-d49bb3a4c8be req-fcb7e770-73de-4922-bd8e-b69b7ec15584 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-8a70c658-7074-44d9-9b69-d49bb3a4c8be req-fcb7e770-73de-4922-bd8e-b69b7ec15584 service nova] Creating event network-vif-unplugged:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:53:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-8a70c658-7074-44d9-9b69-d49bb3a4c8be req-fcb7e770-73de-4922-bd8e-b69b7ec15584 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028371 Nov 27 01:53:42 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 180/541] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:42 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4a743805-7824-4c1e-85cd-b0ac16de0318 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 200 len: 1866 microversion: 2.93 time: 0.221678 Nov 27 01:53:42 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 179/542] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:53:42 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 1866 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:43 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-211e8cc6-4538-4b75-8a04-3dc687d1d76d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1533 microversion: 2.1 time: 0.204543 Nov 27 01:53:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 184/543] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:43 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1533 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:53:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-e64714a4-3253-4cd0-9745-e78c1dbb25b9 req-6cae5ec1-0ad6-4e06-8d73-f8bb278118c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e64714a4-3253-4cd0-9745-e78c1dbb25b9 req-6cae5ec1-0ad6-4e06-8d73-f8bb278118c8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e64714a4-3253-4cd0-9745-e78c1dbb25b9 req-6cae5ec1-0ad6-4e06-8d73-f8bb278118c8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e64714a4-3253-4cd0-9745-e78c1dbb25b9 req-6cae5ec1-0ad6-4e06-8d73-f8bb278118c8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-e64714a4-3253-4cd0-9745-e78c1dbb25b9 req-6cae5ec1-0ad6-4e06-8d73-f8bb278118c8 service nova] Creating event network-changed:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:53:44 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-31cd627d-0d95-427e-8827-a17c72690d48 req-2c46d968-3150-493b-b1ca-2c7402cb1a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-plugged", "status": "completed", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-e64714a4-3253-4cd0-9745-e78c1dbb25b9 req-6cae5ec1-0ad6-4e06-8d73-f8bb278118c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031518 Nov 27 01:53:44 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 181/544] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-31cd627d-0d95-427e-8827-a17c72690d48 req-2c46d968-3150-493b-b1ca-2c7402cb1a48 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-31cd627d-0d95-427e-8827-a17c72690d48 req-2c46d968-3150-493b-b1ca-2c7402cb1a48 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-31cd627d-0d95-427e-8827-a17c72690d48 req-2c46d968-3150-493b-b1ca-2c7402cb1a48 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-31cd627d-0d95-427e-8827-a17c72690d48 req-2c46d968-3150-493b-b1ca-2c7402cb1a48 service nova] Creating event network-vif-plugged:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:53:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-31cd627d-0d95-427e-8827-a17c72690d48 req-2c46d968-3150-493b-b1ca-2c7402cb1a48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039010 Nov 27 01:53:44 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 180/545] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:47 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:47 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-783cacff-05a1-4072-9720-45f4d706a60b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 200 len: 1550 microversion: 2.1 time: 0.189725 Nov 27 01:53:47 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 185/546] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:47 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 1550 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 01:53:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:53 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-bbb32cb3-7ec5-4984-9201-1ca28c55faa7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043726 Nov 27 01:53:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 182/547] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:53:53 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:53:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7e64f102-a81a-4c65-a624-fc946f4d7d3f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 204 len: 0 microversion: 2.1 time: 0.133733 Nov 27 01:53:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 181/548] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:53:53 2023] DELETE /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:53 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:53:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-95d1bc5c-13f6-4fcb-9068-828cf6e43125 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 200 len: 1685 microversion: 2.1 time: 0.240873 Nov 27 01:53:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 186/549] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:53 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 1685 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:53:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-81f48ecc-30a8-4ce8-b921-bdea524f1bdf req-2ce8e8d3-0cfc-4f74-9766-0b179301788f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-unplugged", "status": "completed", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-81f48ecc-30a8-4ce8-b921-bdea524f1bdf req-2ce8e8d3-0cfc-4f74-9766-0b179301788f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-81f48ecc-30a8-4ce8-b921-bdea524f1bdf req-2ce8e8d3-0cfc-4f74-9766-0b179301788f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-81f48ecc-30a8-4ce8-b921-bdea524f1bdf req-2ce8e8d3-0cfc-4f74-9766-0b179301788f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-81f48ecc-30a8-4ce8-b921-bdea524f1bdf req-2ce8e8d3-0cfc-4f74-9766-0b179301788f service nova] Creating event network-vif-unplugged:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:53:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-81f48ecc-30a8-4ce8-b921-bdea524f1bdf req-2ce8e8d3-0cfc-4f74-9766-0b179301788f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038786 Nov 27 01:53:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 183/550] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:56 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-9a4865d3-30bf-4e11-a9ae-acae3331b6bc req-459cf8b1-1685-44b8-952d-02336a41a897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-plugged", "status": "completed", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}, {"server_uuid": "6da3a108-b503-4e6a-a5c2-8ada0a20d145", "name": "network-vif-deleted", "tag": "c60547fc-b849-4fac-8e61-9cdbb3d8c29f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:53:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9a4865d3-30bf-4e11-a9ae-acae3331b6bc req-459cf8b1-1685-44b8-952d-02336a41a897 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9a4865d3-30bf-4e11-a9ae-acae3331b6bc req-459cf8b1-1685-44b8-952d-02336a41a897 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9a4865d3-30bf-4e11-a9ae-acae3331b6bc req-459cf8b1-1685-44b8-952d-02336a41a897 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9a4865d3-30bf-4e11-a9ae-acae3331b6bc req-459cf8b1-1685-44b8-952d-02336a41a897 service nova] Creating event network-vif-plugged:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:53:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9a4865d3-30bf-4e11-a9ae-acae3331b6bc req-459cf8b1-1685-44b8-952d-02336a41a897 service nova] Creating event network-vif-deleted:c60547fc-b849-4fac-8e61-9cdbb3d8c29f for instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 on user Nov 27 01:53:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-9a4865d3-30bf-4e11-a9ae-acae3331b6bc req-459cf8b1-1685-44b8-952d-02336a41a897 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028654 Nov 27 01:53:56 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 182/551] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:53:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] [instance: e4c15d2a-ec55-45b2-8049-afe5e8bb1734] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:53:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] HTTP exception thrown: Instance e4c15d2a-ec55-45b2-8049-afe5e8bb1734 could not be found. Nov 27 01:53:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] Returning 404 to user: Instance e4c15d2a-ec55-45b2-8049-afe5e8bb1734 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:53:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-f728f35c-92dd-4a27-b5c6-e4eef87b9ddb tempest-ServersNegativeTestJSON-1547259665 tempest-ServersNegativeTestJSON-1547259665-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734" status: 404 len: 111 microversion: 2.1 time: 0.027514 Nov 27 01:53:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 187/552] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:53:59 2023] GET /compute/v2.1/servers/e4c15d2a-ec55-45b2-8049-afe5e8bb1734 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:54:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-502057cc-25f4-4564-b2e8-9807fda60d9b req-aded0955-8060-4f3c-86aa-a9a51491872b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "volume-reimaged", "server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "tag": "b1a607cc-cd72-4b80-861d-73894a94f491"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-502057cc-25f4-4564-b2e8-9807fda60d9b req-aded0955-8060-4f3c-86aa-a9a51491872b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-502057cc-25f4-4564-b2e8-9807fda60d9b req-aded0955-8060-4f3c-86aa-a9a51491872b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-502057cc-25f4-4564-b2e8-9807fda60d9b req-aded0955-8060-4f3c-86aa-a9a51491872b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-502057cc-25f4-4564-b2e8-9807fda60d9b req-aded0955-8060-4f3c-86aa-a9a51491872b service nova] Creating event volume-reimaged:b1a607cc-cd72-4b80-861d-73894a94f491 for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:54:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-502057cc-25f4-4564-b2e8-9807fda60d9b req-aded0955-8060-4f3c-86aa-a9a51491872b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.93 time: 0.088461 Nov 27 01:54:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 184/553] 10.0.0.210 () {70 vars in 1437 bytes} [Mon Nov 27 01:54:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] [instance: fe37682d-ddd8-4ddf-8e0a-ead1af33ac81] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:10 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579baf1092cb4cc58598f0e57ebbabee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3319924ef4a4429b8e19ba725f15fa75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-358cf4a5-6b5b-4ae7-b31a-9106bc6ddb69 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81" status: 200 len: 1483 microversion: 2.1 time: 0.512216 Nov 27 01:54:10 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 183/554] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:09 2023] GET /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 => generated 1483 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:54:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-38373d8d-0253-4c95-8e87-be3dc771cf51 req-28ac0153-1ab4-490f-893a-e26af5292168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-plugged", "status": "completed", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:10 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=24 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:10 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-38373d8d-0253-4c95-8e87-be3dc771cf51 req-28ac0153-1ab4-490f-893a-e26af5292168 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-38373d8d-0253-4c95-8e87-be3dc771cf51 req-28ac0153-1ab4-490f-893a-e26af5292168 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-38373d8d-0253-4c95-8e87-be3dc771cf51 req-28ac0153-1ab4-490f-893a-e26af5292168 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-38373d8d-0253-4c95-8e87-be3dc771cf51 req-28ac0153-1ab4-490f-893a-e26af5292168 service nova] Creating event network-vif-plugged:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:54:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-38373d8d-0253-4c95-8e87-be3dc771cf51 req-28ac0153-1ab4-490f-893a-e26af5292168 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038042 Nov 27 01:54:10 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 188/555] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:12 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=33 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:12 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=5,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:12 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-ef5bc1c9-a1f6-42d7-817f-02fbbaf5c8f2 req-0b787904-7488-4416-9ec1-4be5b7c8807f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-plugged", "status": "completed", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ef5bc1c9-a1f6-42d7-817f-02fbbaf5c8f2 req-0b787904-7488-4416-9ec1-4be5b7c8807f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ef5bc1c9-a1f6-42d7-817f-02fbbaf5c8f2 req-0b787904-7488-4416-9ec1-4be5b7c8807f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ef5bc1c9-a1f6-42d7-817f-02fbbaf5c8f2 req-0b787904-7488-4416-9ec1-4be5b7c8807f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-ef5bc1c9-a1f6-42d7-817f-02fbbaf5c8f2 req-0b787904-7488-4416-9ec1-4be5b7c8807f service nova] Creating event network-vif-plugged:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:54:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-ef5bc1c9-a1f6-42d7-817f-02fbbaf5c8f2 req-0b787904-7488-4416-9ec1-4be5b7c8807f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044728 Nov 27 01:54:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 185/556] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:28 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-69a2ce53-43bc-4787-84f0-2a3da983648b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 200 len: 1650 microversion: 2.20 time: 0.203283 Nov 27 01:54:28 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 184/557] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:54:28 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 1650 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-259404659"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:31 user devstack@n-api.service[65194]: INFO nova.network.security_group_api [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Removing security group 40a2202e-e563-4070-b17a-0cdf9bf5cfca from port 6a62e37b-159a-4d5e-b3d6-746fc971ca4e Nov 27 01:54:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a4b69c87-5a08-4e1d-9023-d06861a80e18 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/action" status: 202 len: 0 microversion: 2.1 time: 0.752541 Nov 27 01:54:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 189/558] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:54:31 2023] POST /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:54:32 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:54:32 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-4ba18f12-468c-464e-a8fa-96586494fa48 req-9db2cbc2-c09d-48ed-aed4-3f0e6a7f9f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4ba18f12-468c-464e-a8fa-96586494fa48 req-9db2cbc2-c09d-48ed-aed4-3f0e6a7f9f9b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4ba18f12-468c-464e-a8fa-96586494fa48 req-9db2cbc2-c09d-48ed-aed4-3f0e6a7f9f9b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4ba18f12-468c-464e-a8fa-96586494fa48 req-9db2cbc2-c09d-48ed-aed4-3f0e6a7f9f9b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4ba18f12-468c-464e-a8fa-96586494fa48 req-9db2cbc2-c09d-48ed-aed4-3f0e6a7f9f9b service nova] Creating event network-changed:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-4ba18f12-468c-464e-a8fa-96586494fa48 req-9db2cbc2-c09d-48ed-aed4-3f0e6a7f9f9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098539 Nov 27 01:54:32 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 186/559] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:32 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-086043d1-0b64-4e5f-afdb-55865245d073 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 200 len: 1857 microversion: 2.93 time: 0.465023 Nov 27 01:54:32 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 185/560] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:54:32 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 1857 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:54:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-5012ef96-8a2b-438b-9798-4a36043e55de req-ce4d87d1-4cb0-4d4d-8447-41528f007ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5012ef96-8a2b-438b-9798-4a36043e55de req-ce4d87d1-4cb0-4d4d-8447-41528f007ced service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5012ef96-8a2b-438b-9798-4a36043e55de req-ce4d87d1-4cb0-4d4d-8447-41528f007ced service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5012ef96-8a2b-438b-9798-4a36043e55de req-ce4d87d1-4cb0-4d4d-8447-41528f007ced service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-5012ef96-8a2b-438b-9798-4a36043e55de req-ce4d87d1-4cb0-4d4d-8447-41528f007ced service nova] Creating event network-changed:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:54:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-5012ef96-8a2b-438b-9798-4a36043e55de req-ce4d87d1-4cb0-4d4d-8447-41528f007ced service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035974 Nov 27 01:54:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 190/561] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:33 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lazy-loading 'services' on Instance uuid e6a1a161-3922-48ae-a339-bb4105590b3a {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:54:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d293ede6-aab5-4258-bc0d-318dd9bc1bd5 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments/9dea9692-0970-4361-ab41-24960a46298a" status: 202 len: 0 microversion: 2.1 time: 0.226791 Nov 27 01:54:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 187/562] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:54:33 2023] DELETE /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments/9dea9692-0970-4361-ab41-24960a46298a => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:54:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ed365c49-3920-4186-b492-a7b7dd4a3827 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050226 Nov 27 01:54:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 186/563] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:54:33 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "40f75407-9685-45b5-ac76-b832cf98d609"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:35 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lazy-loading 'flavor' on Instance uuid 3a533e7c-73d1-4422-b8bd-134b2dea325f {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:54:36 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-cd5a5d55-e938-4cc6-9113-49b7183d8299 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f/action" status: 200 len: 29 microversion: 2.87 time: 0.583828 Nov 27 01:54:36 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 191/564] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 01:54:35 2023] POST /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f/action => generated 29 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:36 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:36 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-449e9a34-9656-4011-b344-79950ca53003 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 200 len: 1774 microversion: 2.87 time: 0.251135 Nov 27 01:54:36 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 188/565] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:54:36 2023] GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 1774 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:54:36 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-40c4aa84-fb90-4243-8a8d-0e81394a48a1 req-fdb54e77-b5d0-45c3-b9fd-a04d49456dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-unplugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-40c4aa84-fb90-4243-8a8d-0e81394a48a1 req-fdb54e77-b5d0-45c3-b9fd-a04d49456dfa service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-40c4aa84-fb90-4243-8a8d-0e81394a48a1 req-fdb54e77-b5d0-45c3-b9fd-a04d49456dfa service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-40c4aa84-fb90-4243-8a8d-0e81394a48a1 req-fdb54e77-b5d0-45c3-b9fd-a04d49456dfa service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-40c4aa84-fb90-4243-8a8d-0e81394a48a1 req-fdb54e77-b5d0-45c3-b9fd-a04d49456dfa service nova] Creating event network-vif-unplugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:54:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-40c4aa84-fb90-4243-8a8d-0e81394a48a1 req-fdb54e77-b5d0-45c3-b9fd-a04d49456dfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032612 Nov 27 01:54:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 187/566] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:38 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c06979e5-11c2-4560-b5cc-1d48c7a44f0d req-5e970623-01d5-44fb-a486-f50b62ca29b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c06979e5-11c2-4560-b5cc-1d48c7a44f0d req-5e970623-01d5-44fb-a486-f50b62ca29b6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c06979e5-11c2-4560-b5cc-1d48c7a44f0d req-5e970623-01d5-44fb-a486-f50b62ca29b6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c06979e5-11c2-4560-b5cc-1d48c7a44f0d req-5e970623-01d5-44fb-a486-f50b62ca29b6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:38 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-c06979e5-11c2-4560-b5cc-1d48c7a44f0d req-5e970623-01d5-44fb-a486-f50b62ca29b6 service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:54:38 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c06979e5-11c2-4560-b5cc-1d48c7a44f0d req-5e970623-01d5-44fb-a486-f50b62ca29b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034809 Nov 27 01:54:38 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 192/567] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:40 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-89bb978e-ad1d-415a-bef8-d0d291a39b4c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.258213 Nov 27 01:54:40 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 189/568] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:54:40 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/os-interface => generated 283 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-7a0c833e-40c8-498c-80e3-59dd002d1240 req-d08225d8-f80c-4f52-9fac-b5a5a01ec1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a0c833e-40c8-498c-80e3-59dd002d1240 req-d08225d8-f80c-4f52-9fac-b5a5a01ec1ad service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a0c833e-40c8-498c-80e3-59dd002d1240 req-d08225d8-f80c-4f52-9fac-b5a5a01ec1ad service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a0c833e-40c8-498c-80e3-59dd002d1240 req-d08225d8-f80c-4f52-9fac-b5a5a01ec1ad service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7a0c833e-40c8-498c-80e3-59dd002d1240 req-d08225d8-f80c-4f52-9fac-b5a5a01ec1ad service nova] Creating event network-changed:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:54:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-7a0c833e-40c8-498c-80e3-59dd002d1240 req-d08225d8-f80c-4f52-9fac-b5a5a01ec1ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033951 Nov 27 01:54:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 188/569] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:41 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:41 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:42 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3b8ddef6-0dde-4f73-8374-0692f4c2bbd0 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1542 microversion: 2.1 time: 0.249326 Nov 27 01:54:42 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 193/570] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:41 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1542 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:42 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b1088cbd-b918-4084-a547-609702f4cc8c tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1542 microversion: 2.1 time: 0.179677 Nov 27 01:54:42 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 190/571] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:42 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1542 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:54:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d275c9f8-69ab-4243-b211-60a88df58d5b tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.152776 Nov 27 01:54:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 189/572] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:54:43 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/os-interface => generated 282 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-53df42b0-66ab-4ec8-9b32-a325c0781725 req-608f4618-a5c4-4dc8-b41f-3b02aba4b9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}, {"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-53df42b0-66ab-4ec8-9b32-a325c0781725 req-608f4618-a5c4-4dc8-b41f-3b02aba4b9de service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-53df42b0-66ab-4ec8-9b32-a325c0781725 req-608f4618-a5c4-4dc8-b41f-3b02aba4b9de service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-53df42b0-66ab-4ec8-9b32-a325c0781725 req-608f4618-a5c4-4dc8-b41f-3b02aba4b9de service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-53df42b0-66ab-4ec8-9b32-a325c0781725 req-608f4618-a5c4-4dc8-b41f-3b02aba4b9de service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:54:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-53df42b0-66ab-4ec8-9b32-a325c0781725 req-608f4618-a5c4-4dc8-b41f-3b02aba4b9de service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:54:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-53df42b0-66ab-4ec8-9b32-a325c0781725 req-608f4618-a5c4-4dc8-b41f-3b02aba4b9de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029523 Nov 27 01:54:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 194/573] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 6da3a108-b503-4e6a-a5c2-8ada0a20d145] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] HTTP exception thrown: Instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 could not be found. Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Returning 404 to user: Instance 6da3a108-b503-4e6a-a5c2-8ada0a20d145 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:54:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-50e050f3-0700-4181-9b78-ec56c235fd9c tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145" status: 404 len: 111 microversion: 2.1 time: 0.055716 Nov 27 01:54:44 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 191/574] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:44 2023] GET /compute/v2.1/servers/6da3a108-b503-4e6a-a5c2-8ada0a20d145 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:54:44 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-926378af-3fc6-4d87-a031-066b73368f10 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '.version_select at 0x7f364b4be680>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-926378af-3fc6-4d87-a031-066b73368f10 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762372762" status: 202 len: 0 microversion: 2.1 time: 0.023298 Nov 27 01:54:44 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 190/575] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 01:54:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762372762 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:54:44 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:44 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8ac1fcf8-c040-4432-9c17-18191c27139a tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/ips" status: 200 len: 103 microversion: 2.1 time: 0.042333 Nov 27 01:54:44 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 195/576] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 01:54:44 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/ips => generated 103 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:44 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d74c8d19-9334-470e-8d24-d06c3af7743f tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1661 microversion: 2.1 time: 0.239397 Nov 27 01:54:44 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 192/577] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:44 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1661 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:45 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-abebc7e4-d0ec-4e53-a84a-9efe67ca6fa2 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1661 microversion: 2.1 time: 0.202764 Nov 27 01:54:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 191/578] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:44 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1661 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:45 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:45 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5bb8a26b-a541-4a19-9f11-81abea15d995 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1661 microversion: 2.1 time: 0.167650 Nov 27 01:54:45 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 196/579] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:45 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1661 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:54:45 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-51a3d440-d6b7-4ef9-b535-8579d54267d8 req-65cd5b47-7db2-4e1d-a98c-e97c2f0f1f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-51a3d440-d6b7-4ef9-b535-8579d54267d8 req-65cd5b47-7db2-4e1d-a98c-e97c2f0f1f9b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-51a3d440-d6b7-4ef9-b535-8579d54267d8 req-65cd5b47-7db2-4e1d-a98c-e97c2f0f1f9b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-51a3d440-d6b7-4ef9-b535-8579d54267d8 req-65cd5b47-7db2-4e1d-a98c-e97c2f0f1f9b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:45 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-51a3d440-d6b7-4ef9-b535-8579d54267d8 req-65cd5b47-7db2-4e1d-a98c-e97c2f0f1f9b service nova] Creating event network-changed:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:54:45 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-51a3d440-d6b7-4ef9-b535-8579d54267d8 req-65cd5b47-7db2-4e1d-a98c-e97c2f0f1f9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034967 Nov 27 01:54:45 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 193/580] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:47 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ab5f227-9168-40b3-b11a-9b8bc5dabde7"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:47 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:47 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3f963fa0-5175-4648-b070-c456a0100355 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317158 Nov 27 01:54:47 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 192/581] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:54:47 2023] POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:47 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:47 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:48 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ca37b53c-1e13-4f31-8f79-504955f86328 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.189758 Nov 27 01:54:48 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 197/582] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:54:47 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-interface => generated 283 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6571c3bb-5b02-4a4f-84d0-453a5da863e7 req-8eb1405a-5b04-48ac-a296-4f460239237e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6571c3bb-5b02-4a4f-84d0-453a5da863e7 req-8eb1405a-5b04-48ac-a296-4f460239237e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6571c3bb-5b02-4a4f-84d0-453a5da863e7 req-8eb1405a-5b04-48ac-a296-4f460239237e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6571c3bb-5b02-4a4f-84d0-453a5da863e7 req-8eb1405a-5b04-48ac-a296-4f460239237e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6571c3bb-5b02-4a4f-84d0-453a5da863e7 req-8eb1405a-5b04-48ac-a296-4f460239237e service nova] Creating event network-changed:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:54:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6571c3bb-5b02-4a4f-84d0-453a5da863e7 req-8eb1405a-5b04-48ac-a296-4f460239237e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106377 Nov 27 01:54:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 194/583] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:49 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "606828a7-ce62-441e-bef2-2b06b7c18321"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:49 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-63b29112-909c-43c6-bb7b-34eccb5d0c9c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298544 Nov 27 01:54:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 193/584] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:54:49 2023] POST /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d767c7d9-25e5-455c-ab9d-09162bc4870f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d767c7d9-25e5-455c-ab9d-09162bc4870f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d767c7d9-25e5-455c-ab9d-09162bc4870f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d767c7d9-25e5-455c-ab9d-09162bc4870f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:57 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d767c7d9-25e5-455c-ab9d-09162bc4870f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Going to try to stop instance {{(pid=65194) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 27 01:54:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d767c7d9-25e5-455c-ab9d-09162bc4870f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/action" status: 202 len: 0 microversion: 2.1 time: 0.128021 Nov 27 01:54:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 198/585] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:54:57 2023] POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:54:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:57 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:58 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-340b7d0e-64f0-467e-aadf-a57a06a25cad tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1708 microversion: 2.1 time: 0.406530 Nov 27 01:54:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 195/586] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:57 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1708 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:54:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-072a388e-e2a7-4ced-a3ea-6baaddc40656 req-62011967-aa71-48ed-a621-99108150983f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-unplugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-072a388e-e2a7-4ced-a3ea-6baaddc40656 req-62011967-aa71-48ed-a621-99108150983f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-072a388e-e2a7-4ced-a3ea-6baaddc40656 req-62011967-aa71-48ed-a621-99108150983f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-072a388e-e2a7-4ced-a3ea-6baaddc40656 req-62011967-aa71-48ed-a621-99108150983f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-072a388e-e2a7-4ced-a3ea-6baaddc40656 req-62011967-aa71-48ed-a621-99108150983f service nova] Creating event network-vif-unplugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:54:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-072a388e-e2a7-4ced-a3ea-6baaddc40656 req-62011967-aa71-48ed-a621-99108150983f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037570 Nov 27 01:54:58 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 194/587] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:54:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:59 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lazy-loading 'flavor' on Instance uuid 0e1143aa-dcb8-4970-b80a-0a9818e1b733 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:54:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2f6a040e-8903-4ea1-a65c-5d6804759091 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/action" status: 200 len: 32 microversion: 2.1 time: 0.146997 Nov 27 01:54:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 199/588] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:54:59 2023] POST /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:54:59 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:54:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-6189a9c9-8637-4475-989d-c1e1c3af3717 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 200 len: 1721 microversion: 2.1 time: 0.193322 Nov 27 01:54:59 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 196/589] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:54:59 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:55:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-8ee784e2-e304-4395-8f55-6cd7ab84d6b1 req-48905900-396f-476d-b7d8-d2e44fc198ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8ee784e2-e304-4395-8f55-6cd7ab84d6b1 req-48905900-396f-476d-b7d8-d2e44fc198ac service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8ee784e2-e304-4395-8f55-6cd7ab84d6b1 req-48905900-396f-476d-b7d8-d2e44fc198ac service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8ee784e2-e304-4395-8f55-6cd7ab84d6b1 req-48905900-396f-476d-b7d8-d2e44fc198ac service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-8ee784e2-e304-4395-8f55-6cd7ab84d6b1 req-48905900-396f-476d-b7d8-d2e44fc198ac service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:55:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-8ee784e2-e304-4395-8f55-6cd7ab84d6b1 req-48905900-396f-476d-b7d8-d2e44fc198ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031088 Nov 27 01:55:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 200/590] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-60db8e15-d921-4ea4-8d51-f14d374566f8 req-b0acbbcf-a8b3-4696-92be-33936c70a55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-unplugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-60db8e15-d921-4ea4-8d51-f14d374566f8 req-b0acbbcf-a8b3-4696-92be-33936c70a55a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-60db8e15-d921-4ea4-8d51-f14d374566f8 req-b0acbbcf-a8b3-4696-92be-33936c70a55a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-60db8e15-d921-4ea4-8d51-f14d374566f8 req-b0acbbcf-a8b3-4696-92be-33936c70a55a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-60db8e15-d921-4ea4-8d51-f14d374566f8 req-b0acbbcf-a8b3-4696-92be-33936c70a55a service nova] Creating event network-vif-unplugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:55:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-60db8e15-d921-4ea4-8d51-f14d374566f8 req-b0acbbcf-a8b3-4696-92be-33936c70a55a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.241651 Nov 27 01:55:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 195/591] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:02 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-b80c8795-0902-4a22-a110-5e47aee11e83 req-8bec94a3-7b87-41bf-8e4d-1e272e4ab489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b80c8795-0902-4a22-a110-5e47aee11e83 req-8bec94a3-7b87-41bf-8e4d-1e272e4ab489 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b80c8795-0902-4a22-a110-5e47aee11e83 req-8bec94a3-7b87-41bf-8e4d-1e272e4ab489 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b80c8795-0902-4a22-a110-5e47aee11e83 req-8bec94a3-7b87-41bf-8e4d-1e272e4ab489 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-b80c8795-0902-4a22-a110-5e47aee11e83 req-8bec94a3-7b87-41bf-8e4d-1e272e4ab489 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:55:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-b80c8795-0902-4a22-a110-5e47aee11e83 req-8bec94a3-7b87-41bf-8e4d-1e272e4ab489 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030131 Nov 27 01:55:02 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 197/592] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:04 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-230094cb-9868-4fe2-862f-89f2f661cc93 req-659c94ef-4dc8-4b0a-a479-de07f5181632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}, {"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-230094cb-9868-4fe2-862f-89f2f661cc93 req-659c94ef-4dc8-4b0a-a479-de07f5181632 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-230094cb-9868-4fe2-862f-89f2f661cc93 req-659c94ef-4dc8-4b0a-a479-de07f5181632 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-230094cb-9868-4fe2-862f-89f2f661cc93 req-659c94ef-4dc8-4b0a-a479-de07f5181632 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-230094cb-9868-4fe2-862f-89f2f661cc93 req-659c94ef-4dc8-4b0a-a479-de07f5181632 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:55:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-230094cb-9868-4fe2-862f-89f2f661cc93 req-659c94ef-4dc8-4b0a-a479-de07f5181632 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:55:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-230094cb-9868-4fe2-862f-89f2f661cc93 req-659c94ef-4dc8-4b0a-a479-de07f5181632 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034764 Nov 27 01:55:04 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 201/593] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] [instance: fe37682d-ddd8-4ddf-8e0a-ead1af33ac81] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] [instance: fe37682d-ddd8-4ddf-8e0a-ead1af33ac81] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:55:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-efe0d2d0-c840-41e4-bf84-f395f58ee041 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81" status: 204 len: 0 microversion: 2.1 time: 0.457995 Nov 27 01:55:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 196/594] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:55:17 2023] DELETE /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=26 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] [instance: fe37682d-ddd8-4ddf-8e0a-ead1af33ac81] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:18 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579baf1092cb4cc58598f0e57ebbabee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3319924ef4a4429b8e19ba725f15fa75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-aa53830a-7461-4d9b-873a-d35891d7003d tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81" status: 200 len: 1489 microversion: 2.1 time: 0.370901 Nov 27 01:55:18 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 198/595] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:55:17 2023] GET /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 => generated 1489 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:55:18 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=26 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:55:18 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:55:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-09f4bae8-5aca-45e8-8c30-7bc5d3cbbe43 req-9986f4c5-140a-4e75-a05c-d1bee62a5136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe37682d-ddd8-4ddf-8e0a-ead1af33ac81", "name": "network-vif-unplugged", "status": "completed", "tag": "18360711-d8e6-443f-a9b7-0116d2743ccd"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-09f4bae8-5aca-45e8-8c30-7bc5d3cbbe43 req-9986f4c5-140a-4e75-a05c-d1bee62a5136 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-09f4bae8-5aca-45e8-8c30-7bc5d3cbbe43 req-9986f4c5-140a-4e75-a05c-d1bee62a5136 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-09f4bae8-5aca-45e8-8c30-7bc5d3cbbe43 req-9986f4c5-140a-4e75-a05c-d1bee62a5136 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-09f4bae8-5aca-45e8-8c30-7bc5d3cbbe43 req-9986f4c5-140a-4e75-a05c-d1bee62a5136 service nova] Creating event network-vif-unplugged:18360711-d8e6-443f-a9b7-0116d2743ccd for instance fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 on user Nov 27 01:55:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-09f4bae8-5aca-45e8-8c30-7bc5d3cbbe43 req-9986f4c5-140a-4e75-a05c-d1bee62a5136 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148772 Nov 27 01:55:18 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 202/596] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:55:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-328c6a2f-6036-44f5-8eef-6d3d92836294 req-7c2e69ad-1ddb-4a87-a11b-fda40ad889ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe37682d-ddd8-4ddf-8e0a-ead1af33ac81", "name": "network-vif-deleted", "tag": "18360711-d8e6-443f-a9b7-0116d2743ccd"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-328c6a2f-6036-44f5-8eef-6d3d92836294 req-7c2e69ad-1ddb-4a87-a11b-fda40ad889ac service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-328c6a2f-6036-44f5-8eef-6d3d92836294 req-7c2e69ad-1ddb-4a87-a11b-fda40ad889ac service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-328c6a2f-6036-44f5-8eef-6d3d92836294 req-7c2e69ad-1ddb-4a87-a11b-fda40ad889ac service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-328c6a2f-6036-44f5-8eef-6d3d92836294 req-7c2e69ad-1ddb-4a87-a11b-fda40ad889ac service nova] Creating event network-vif-deleted:18360711-d8e6-443f-a9b7-0116d2743ccd for instance fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 on user Nov 27 01:55:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-328c6a2f-6036-44f5-8eef-6d3d92836294 req-7c2e69ad-1ddb-4a87-a11b-fda40ad889ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048849 Nov 27 01:55:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 197/597] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:20 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6c8f6430-c0fd-4148-a0c0-fbdf0ab8fec4 req-b106d1ab-c967-4fe3-975c-0feb2fd2a105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe37682d-ddd8-4ddf-8e0a-ead1af33ac81", "name": "network-vif-plugged", "status": "completed", "tag": "18360711-d8e6-443f-a9b7-0116d2743ccd"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6c8f6430-c0fd-4148-a0c0-fbdf0ab8fec4 req-b106d1ab-c967-4fe3-975c-0feb2fd2a105 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6c8f6430-c0fd-4148-a0c0-fbdf0ab8fec4 req-b106d1ab-c967-4fe3-975c-0feb2fd2a105 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6c8f6430-c0fd-4148-a0c0-fbdf0ab8fec4 req-b106d1ab-c967-4fe3-975c-0feb2fd2a105 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6c8f6430-c0fd-4148-a0c0-fbdf0ab8fec4 req-b106d1ab-c967-4fe3-975c-0feb2fd2a105 service nova] Creating event network-vif-plugged:18360711-d8e6-443f-a9b7-0116d2743ccd for instance fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 on user Nov 27 01:55:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6c8f6430-c0fd-4148-a0c0-fbdf0ab8fec4 req-b106d1ab-c967-4fe3-975c-0feb2fd2a105 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 Nov 27 01:55:20 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 199/598] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:23 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:23 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c733a023-251e-4a8d-a298-c64431d3040a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.178104 Nov 27 01:55:23 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 203/599] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:55:23 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments => generated 25 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] HTTP exception thrown: Instance e6a1a161-3922-48ae-a339-bb4105590b3a is not attached to volume 9dea9692-0970-4361-ab41-24960a46298a Nov 27 01:55:23 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Returning 404 to user: Instance e6a1a161-3922-48ae-a339-bb4105590b3a is not attached to volume 9dea9692-0970-4361-ab41-24960a46298a {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:55:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-68969064-822a-4a2f-9f99-e7bc4296d3a3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments/9dea9692-0970-4361-ab41-24960a46298a" status: 404 len: 154 microversion: 2.1 time: 0.131368 Nov 27 01:55:23 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 198/600] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:55:23 2023] DELETE /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a/os-volume_attachments/9dea9692-0970-4361-ab41-24960a46298a => generated 154 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:26 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b46f55d1-52f9-4d68-bec0-4c98db57678e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 200 len: 1754 microversion: 2.87 time: 0.216130 Nov 27 01:55:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 200/601] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:55:26 2023] GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:55:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0058f55d-b465-49ce-8fc6-a66e79e7969e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 204 len: 0 microversion: 2.1 time: 0.116127 Nov 27 01:55:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 204/602] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:55:27 2023] DELETE /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:27 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:27 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7eaac29e-c1d5-4557-8fe8-a2fb22406950 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 200 len: 1537 microversion: 2.1 time: 0.197548 Nov 27 01:55:27 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 199/603] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:55:27 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:55:27 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6a2a0211-9023-4b82-a833-41bba6ee7781 req-7ba22acc-46f0-4f0e-a1ba-2b1f41ac3638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-unplugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6a2a0211-9023-4b82-a833-41bba6ee7781 req-7ba22acc-46f0-4f0e-a1ba-2b1f41ac3638 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6a2a0211-9023-4b82-a833-41bba6ee7781 req-7ba22acc-46f0-4f0e-a1ba-2b1f41ac3638 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6a2a0211-9023-4b82-a833-41bba6ee7781 req-7ba22acc-46f0-4f0e-a1ba-2b1f41ac3638 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6a2a0211-9023-4b82-a833-41bba6ee7781 req-7ba22acc-46f0-4f0e-a1ba-2b1f41ac3638 service nova] Creating event network-vif-unplugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:55:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6a2a0211-9023-4b82-a833-41bba6ee7781 req-7ba22acc-46f0-4f0e-a1ba-2b1f41ac3638 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035297 Nov 27 01:55:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 201/604] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-5e263ce9-41a4-45d3-a69c-1949bc6f4c17 req-127e81a7-674d-47c6-8019-36798bfa7ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-deleted", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5e263ce9-41a4-45d3-a69c-1949bc6f4c17 req-127e81a7-674d-47c6-8019-36798bfa7ad4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5e263ce9-41a4-45d3-a69c-1949bc6f4c17 req-127e81a7-674d-47c6-8019-36798bfa7ad4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-5e263ce9-41a4-45d3-a69c-1949bc6f4c17 req-127e81a7-674d-47c6-8019-36798bfa7ad4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-5e263ce9-41a4-45d3-a69c-1949bc6f4c17 req-127e81a7-674d-47c6-8019-36798bfa7ad4 service nova] Creating event network-vif-deleted:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:55:29 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a4763b6-9f37-414e-9750-d5bdbfba6b87"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:29 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-5e263ce9-41a4-45d3-a69c-1949bc6f4c17 req-127e81a7-674d-47c6-8019-36798bfa7ad4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028251 Nov 27 01:55:29 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 200/605] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-22ae2cca-cb03-43aa-af29-faa7dd0e5479 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.432567 Nov 27 01:55:29 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 205/606] 10.0.0.210 () {66 vars in 1441 bytes} [Mon Nov 27 01:55:28 2023] POST /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 01:55:29 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:29 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:29 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:29 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3e0c2514-6b37-4d38-af0f-bfa7e9356813 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/os-volume_attachments/4a4763b6-9f37-414e-9750-d5bdbfba6b87" status: 202 len: 0 microversion: 2.20 time: 0.226921 Nov 27 01:55:29 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 202/607] 10.0.0.210 () {64 vars in 1534 bytes} [Mon Nov 27 01:55:29 2023] DELETE /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/os-volume_attachments/4a4763b6-9f37-414e-9750-d5bdbfba6b87 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-492c5997-2a99-4afc-b08a-bf3cb30cd491 req-c30694af-4c53-4d22-a7c4-c5ac32415020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1a161-3922-48ae-a339-bb4105590b3a", "name": "network-vif-plugged", "status": "completed", "tag": "6a62e37b-159a-4d5e-b3d6-746fc971ca4e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-492c5997-2a99-4afc-b08a-bf3cb30cd491 req-c30694af-4c53-4d22-a7c4-c5ac32415020 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-492c5997-2a99-4afc-b08a-bf3cb30cd491 req-c30694af-4c53-4d22-a7c4-c5ac32415020 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-492c5997-2a99-4afc-b08a-bf3cb30cd491 req-c30694af-4c53-4d22-a7c4-c5ac32415020 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-492c5997-2a99-4afc-b08a-bf3cb30cd491 req-c30694af-4c53-4d22-a7c4-c5ac32415020 service nova] Creating event network-vif-plugged:6a62e37b-159a-4d5e-b3d6-746fc971ca4e for instance e6a1a161-3922-48ae-a339-bb4105590b3a on user Nov 27 01:55:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-492c5997-2a99-4afc-b08a-bf3cb30cd491 req-c30694af-4c53-4d22-a7c4-c5ac32415020 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035415 Nov 27 01:55:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 206/608] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:30 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65193) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 27 01:55:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-01c78822-bbc5-4928-a996-c1c5649da344 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/action" status: 202 len: 0 microversion: 2.20 time: 0.281099 Nov 27 01:55:30 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 201/609] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 01:55:29 2023] POST /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:30 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:30 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d037dbd3-6930-47dd-8153-dbd0318bb6ed tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 200 len: 1658 microversion: 2.20 time: 0.198963 Nov 27 01:55:30 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 203/610] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:55:30 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 1658 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-b4f51cd0-45b4-48c1-b1b1-0b40b991a6dc req-56c7de8f-e886-4207-8c20-8a4ea253bf98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b4f51cd0-45b4-48c1-b1b1-0b40b991a6dc req-56c7de8f-e886-4207-8c20-8a4ea253bf98 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b4f51cd0-45b4-48c1-b1b1-0b40b991a6dc req-56c7de8f-e886-4207-8c20-8a4ea253bf98 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b4f51cd0-45b4-48c1-b1b1-0b40b991a6dc req-56c7de8f-e886-4207-8c20-8a4ea253bf98 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-b4f51cd0-45b4-48c1-b1b1-0b40b991a6dc req-56c7de8f-e886-4207-8c20-8a4ea253bf98 service nova] Creating event network-changed:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:55:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-b4f51cd0-45b4-48c1-b1b1-0b40b991a6dc req-56c7de8f-e886-4207-8c20-8a4ea253bf98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031417 Nov 27 01:55:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 207/611] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:32 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-785123cc-dedb-4ed5-8b43-006ced553fa6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1661 microversion: 2.1 time: 0.282947 Nov 27 01:55:32 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 202/612] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:55:32 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1661 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:55:32 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:32 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:33 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-2242aa03-2635-472b-915a-c23fcca795c6 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1661 microversion: 2.1 time: 0.360824 Nov 27 01:55:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 204/613] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:55:32 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1661 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:55:33 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:33 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:33 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2771fc00-16bb-4cf4-b4e9-27b7572fd51c tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 200 len: 1857 microversion: 2.93 time: 0.249595 Nov 27 01:55:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 208/614] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:55:32 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 1857 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:55:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7d99b2a9-8307-4836-a512-cb02d68d0cbc tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 204 len: 0 microversion: 2.93 time: 0.442836 Nov 27 01:55:34 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 203/615] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:55:33 2023] DELETE /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:34 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d4ce4a1e-4b21-4ae2-96dc-b70245ccbfd8 req-17ea8f41-8bcb-4b52-9bf5-1175c9bdd8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-unplugged", "status": "completed", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d4ce4a1e-4b21-4ae2-96dc-b70245ccbfd8 req-17ea8f41-8bcb-4b52-9bf5-1175c9bdd8ab service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d4ce4a1e-4b21-4ae2-96dc-b70245ccbfd8 req-17ea8f41-8bcb-4b52-9bf5-1175c9bdd8ab service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d4ce4a1e-4b21-4ae2-96dc-b70245ccbfd8 req-17ea8f41-8bcb-4b52-9bf5-1175c9bdd8ab service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:34 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18ba391d043d4c798e2046791cf1941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9364a4c1bedd4dc68e97240fee6eba62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-48007262-03bb-40fe-b6b1-06dd7dff6738 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 200 len: 1863 microversion: 2.93 time: 0.368980 Nov 27 01:55:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 205/616] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:55:34 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 1863 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:55:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d4ce4a1e-4b21-4ae2-96dc-b70245ccbfd8 req-17ea8f41-8bcb-4b52-9bf5-1175c9bdd8ab service nova] Creating event network-vif-unplugged:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:55:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d4ce4a1e-4b21-4ae2-96dc-b70245ccbfd8 req-17ea8f41-8bcb-4b52-9bf5-1175c9bdd8ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052957 Nov 27 01:55:34 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 209/617] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:55:36 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-3c9f6bba-b350-428e-bd1a-27423bcb42e5 req-ec67a815-8a1b-494c-a6ae-1bf77592f43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-deleted", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3c9f6bba-b350-428e-bd1a-27423bcb42e5 req-ec67a815-8a1b-494c-a6ae-1bf77592f43d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3c9f6bba-b350-428e-bd1a-27423bcb42e5 req-ec67a815-8a1b-494c-a6ae-1bf77592f43d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3c9f6bba-b350-428e-bd1a-27423bcb42e5 req-ec67a815-8a1b-494c-a6ae-1bf77592f43d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-3c9f6bba-b350-428e-bd1a-27423bcb42e5 req-ec67a815-8a1b-494c-a6ae-1bf77592f43d service nova] Creating event network-vif-deleted:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:55:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-3c9f6bba-b350-428e-bd1a-27423bcb42e5 req-ec67a815-8a1b-494c-a6ae-1bf77592f43d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030655 Nov 27 01:55:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 204/618] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:36 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-4c93a414-4119-4a86-9f0b-6db6eb0ab21f req-e82299a6-0ea2-47e5-860d-c94ba205d0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c9e788-7241-40f7-843f-f2faeb7799ee", "name": "network-vif-plugged", "status": "completed", "tag": "3198e01b-64f2-4a32-92af-f0a03831f77c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4c93a414-4119-4a86-9f0b-6db6eb0ab21f req-e82299a6-0ea2-47e5-860d-c94ba205d0b6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4c93a414-4119-4a86-9f0b-6db6eb0ab21f req-e82299a6-0ea2-47e5-860d-c94ba205d0b6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4c93a414-4119-4a86-9f0b-6db6eb0ab21f req-e82299a6-0ea2-47e5-860d-c94ba205d0b6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:36 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4c93a414-4119-4a86-9f0b-6db6eb0ab21f req-e82299a6-0ea2-47e5-860d-c94ba205d0b6 service nova] Creating event network-vif-plugged:3198e01b-64f2-4a32-92af-f0a03831f77c for instance e9c9e788-7241-40f7-843f-f2faeb7799ee on user Nov 27 01:55:36 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-4c93a414-4119-4a86-9f0b-6db6eb0ab21f req-e82299a6-0ea2-47e5-860d-c94ba205d0b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039819 Nov 27 01:55:36 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 206/619] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:55:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-e694efa5-ea19-4b85-b022-5a1e43aac57c req-b07a859e-190a-4c88-9bf7-0dbafb9240e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-plugged", "status": "completed", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e694efa5-ea19-4b85-b022-5a1e43aac57c req-b07a859e-190a-4c88-9bf7-0dbafb9240e2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e694efa5-ea19-4b85-b022-5a1e43aac57c req-b07a859e-190a-4c88-9bf7-0dbafb9240e2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e694efa5-ea19-4b85-b022-5a1e43aac57c req-b07a859e-190a-4c88-9bf7-0dbafb9240e2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-e694efa5-ea19-4b85-b022-5a1e43aac57c req-b07a859e-190a-4c88-9bf7-0dbafb9240e2 service nova] Creating event network-vif-plugged:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:55:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-e694efa5-ea19-4b85-b022-5a1e43aac57c req-b07a859e-190a-4c88-9bf7-0dbafb9240e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042472 Nov 27 01:55:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 210/620] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:42 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-21678bfd-462f-4e41-90bf-bcefcd4a9b70 req-96064c26-905e-40d2-8f8e-6eb123fec481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-plugged", "status": "completed", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-21678bfd-462f-4e41-90bf-bcefcd4a9b70 req-96064c26-905e-40d2-8f8e-6eb123fec481 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-21678bfd-462f-4e41-90bf-bcefcd4a9b70 req-96064c26-905e-40d2-8f8e-6eb123fec481 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-21678bfd-462f-4e41-90bf-bcefcd4a9b70 req-96064c26-905e-40d2-8f8e-6eb123fec481 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-21678bfd-462f-4e41-90bf-bcefcd4a9b70 req-96064c26-905e-40d2-8f8e-6eb123fec481 service nova] Creating event network-vif-plugged:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:55:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-21678bfd-462f-4e41-90bf-bcefcd4a9b70 req-96064c26-905e-40d2-8f8e-6eb123fec481 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037289 Nov 27 01:55:42 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 205/621] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=22 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:48 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-85c12de6-f596-426d-bceb-5ebc77f7b957 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1685 microversion: 2.1 time: 0.211674 Nov 27 01:55:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 207/622] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:55:48 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1685 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:49 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:49 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-fc29bd9e-76d2-4d41-b979-6f68883b6d05 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 200 len: 1701 microversion: 2.1 time: 0.214720 Nov 27 01:55:49 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 211/623] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:55:49 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 1701 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-127030341", "imageRef": "", "flavorRef": "1", "networks": [{"uuid": "02938945-a111-40c2-94ba-4203299781f0"}], "security_groups": [{"name": "tempest-securitygroup--1650751541"}], "key_name": "tempest-keypair-1334375291", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a0537543-e0ab-4cc4-b2eb-da076b564739", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] validate_networks() for [('02938945-a111-40c2-94ba-4203299781f0', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for user 4d1d312ea9224e4b9e57e5576276a485 and project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:55:50 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0537543-e0ab-4cc4-b2eb-da076b564739',volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:55:51 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-93fa841f-2b17-404a-99dc-7798a0cc6619 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.715840 Nov 27 01:55:51 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 206/624] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:55:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:55:51 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0618fc23-b4d1-445f-ad2b-bb324272ab67 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:55:51 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0618fc23-b4d1-445f-ad2b-bb324272ab67 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:55:51 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-0618fc23-b4d1-445f-ad2b-bb324272ab67 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:55:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-0618fc23-b4d1-445f-ad2b-bb324272ab67 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1075 microversion: 2.1 time: 0.063027 Nov 27 01:55:51 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 208/625] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:55:51 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1075 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:55:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-03945d65-2f69-4cb1-bbde-d42b3b36d783 req-680e9f5e-9ced-47db-8f3f-d397d807c875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:55:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-03945d65-2f69-4cb1-bbde-d42b3b36d783 req-680e9f5e-9ced-47db-8f3f-d397d807c875 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:55:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-03945d65-2f69-4cb1-bbde-d42b3b36d783 req-680e9f5e-9ced-47db-8f3f-d397d807c875 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:55:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-03945d65-2f69-4cb1-bbde-d42b3b36d783 req-680e9f5e-9ced-47db-8f3f-d397d807c875 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:55:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-03945d65-2f69-4cb1-bbde-d42b3b36d783 req-680e9f5e-9ced-47db-8f3f-d397d807c875 service nova] Creating event network-changed:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 01:55:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-03945d65-2f69-4cb1-bbde-d42b3b36d783 req-680e9f5e-9ced-47db-8f3f-d397d807c875 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034599 Nov 27 01:55:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 212/626] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:55:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:01 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-abbb57b3-dcf9-42ad-b649-01b218346f65 req-92a40581-ff59-4878-881c-81f07977adcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-plugged", "status": "completed", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-abbb57b3-dcf9-42ad-b649-01b218346f65 req-92a40581-ff59-4878-881c-81f07977adcd service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-abbb57b3-dcf9-42ad-b649-01b218346f65 req-92a40581-ff59-4878-881c-81f07977adcd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-abbb57b3-dcf9-42ad-b649-01b218346f65 req-92a40581-ff59-4878-881c-81f07977adcd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-abbb57b3-dcf9-42ad-b649-01b218346f65 req-92a40581-ff59-4878-881c-81f07977adcd service nova] Creating event network-vif-plugged:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 01:56:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-abbb57b3-dcf9-42ad-b649-01b218346f65 req-92a40581-ff59-4878-881c-81f07977adcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044170 Nov 27 01:56:01 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 207/627] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:03 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-3b7c0ad3-1614-4e16-97e8-092be8965299 req-276242db-cc91-4eed-ab51-3dcfc146bbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-plugged", "status": "completed", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:03 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:03 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:03 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3b7c0ad3-1614-4e16-97e8-092be8965299 req-276242db-cc91-4eed-ab51-3dcfc146bbb2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3b7c0ad3-1614-4e16-97e8-092be8965299 req-276242db-cc91-4eed-ab51-3dcfc146bbb2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3b7c0ad3-1614-4e16-97e8-092be8965299 req-276242db-cc91-4eed-ab51-3dcfc146bbb2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-3b7c0ad3-1614-4e16-97e8-092be8965299 req-276242db-cc91-4eed-ab51-3dcfc146bbb2 service nova] Creating event network-vif-plugged:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 01:56:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-3b7c0ad3-1614-4e16-97e8-092be8965299 req-276242db-cc91-4eed-ab51-3dcfc146bbb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038564 Nov 27 01:56:03 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 209/628] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] [instance: fe37682d-ddd8-4ddf-8e0a-ead1af33ac81] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] HTTP exception thrown: Instance fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 could not be found. Nov 27 01:56:08 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] Returning 404 to user: Instance fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:56:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-7bdd475a-aad3-43d8-9fb0-556fa3ab9e34 tempest-VolumesActionsTest-74560522 tempest-VolumesActionsTest-74560522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81" status: 404 len: 111 microversion: 2.1 time: 0.041506 Nov 27 01:56:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 213/629] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:56:08 2023] GET /compute/v2.1/servers/fe37682d-ddd8-4ddf-8e0a-ead1af33ac81 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: e6a1a161-3922-48ae-a339-bb4105590b3a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] HTTP exception thrown: Instance e6a1a161-3922-48ae-a339-bb4105590b3a could not be found. Nov 27 01:56:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Returning 404 to user: Instance e6a1a161-3922-48ae-a339-bb4105590b3a could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:56:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4bbdc407-7c32-4ce7-b570-7abe7ca777bb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a" status: 404 len: 111 microversion: 2.1 time: 0.033664 Nov 27 01:56:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 208/630] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:56:17 2023] GET /compute/v2.1/servers/e6a1a161-3922-48ae-a339-bb4105590b3a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 01:56:17 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:17 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4faedca6-abc6-4cb2-b408-c20baa5749d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '.version_select at 0x7f364b16d000>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4faedca6-abc6-4cb2-b408-c20baa5749d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-21288415" status: 202 len: 0 microversion: 2.1 time: 0.040833 Nov 27 01:56:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 210/631] 10.0.0.210 () {62 vars in 1343 bytes} [Mon Nov 27 01:56:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-21288415 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:56:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-1feed1b4-4587-49b5-bbe6-a033549de8d9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'create', calling method: .version_select at 0x7f364b4e6ef0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1854039273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo45/XG7Mgr+ESDoM3FOG3LtgIn9egBNgBXLj4QlERDSldVWX21vw4Mbeo96PHEePUWMDv4dkBv7TfRpvD/1PyJITKJJ61K8L7zrEYZGg9Q+loaUvZ4godZMx/5SBorEQ=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:20 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:20 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-1feed1b4-4587-49b5-bbe6-a033549de8d9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Getting quotas for project d7e2e5ce3c4145fb92668e1a767d9881. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:56:20 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-1feed1b4-4587-49b5-bbe6-a033549de8d9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Getting quotas for user 10716a7e05b54eef981b7c20e6b796ce and project d7e2e5ce3c4145fb92668e1a767d9881. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:56:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-1feed1b4-4587-49b5-bbe6-a033549de8d9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048445 Nov 27 01:56:20 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 214/632] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:56:20 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1639395288", "imageRef": "bfa9b630-06c5-4fd0-a6b8-0224ac2afdf8", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-1854039273", "networks": [{"uuid": "306b810a-8eb3-47fc-9c31-263d2db4207d"}]}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] validate_networks() for [('306b810a-8eb3-47fc-9c31-263d2db4207d', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:20 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-774850e2-979c-4cb7-b791-615606c826f8 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 200 len: 1703 microversion: 2.20 time: 0.214366 Nov 27 01:56:20 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 211/633] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:56:20 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 1703 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Getting quotas for project d7e2e5ce3c4145fb92668e1a767d9881. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Getting quotas for user 10716a7e05b54eef981b7c20e6b796ce and project d7e2e5ce3c4145fb92668e1a767d9881. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:56:20 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bfa9b630-06c5-4fd0-a6b8-0224ac2afdf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:56:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-148404e0-e5dd-4596-a38f-262314ab96f2 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.482850 Nov 27 01:56:20 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 209/634] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:56:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:56:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-39b64475-fb7f-402f-abd9-e631371bba0d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:20 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-39b64475-fb7f-402f-abd9-e631371bba0d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:21 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-39b64475-fb7f-402f-abd9-e631371bba0d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-39b64475-fb7f-402f-abd9-e631371bba0d tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1251 microversion: 2.1 time: 0.175207 Nov 27 01:56:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 215/635] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:56:20 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1251 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:56:23 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-ef4fc7e3-580d-4c00-bcad-28709e972458 req-75af5e08-e905-4aab-a19c-609a158c027b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ef4fc7e3-580d-4c00-bcad-28709e972458 req-75af5e08-e905-4aab-a19c-609a158c027b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ef4fc7e3-580d-4c00-bcad-28709e972458 req-75af5e08-e905-4aab-a19c-609a158c027b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ef4fc7e3-580d-4c00-bcad-28709e972458 req-75af5e08-e905-4aab-a19c-609a158c027b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-ef4fc7e3-580d-4c00-bcad-28709e972458 req-75af5e08-e905-4aab-a19c-609a158c027b service nova] Creating event network-changed:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:56:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-ef4fc7e3-580d-4c00-bcad-28709e972458 req-75af5e08-e905-4aab-a19c-609a158c027b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057256 Nov 27 01:56:23 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 212/636] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] [instance: e9c9e788-7241-40f7-843f-f2faeb7799ee] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] HTTP exception thrown: Instance e9c9e788-7241-40f7-843f-f2faeb7799ee could not be found. Nov 27 01:56:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Returning 404 to user: Instance e9c9e788-7241-40f7-843f-f2faeb7799ee could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:56:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6f9e3b6c-2fa3-44ac-96ca-7567fd312818 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee" status: 404 len: 111 microversion: 2.93 time: 0.042254 Nov 27 01:56:24 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 210/637] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:56:24 2023] GET /compute/v2.1/servers/e9c9e788-7241-40f7-843f-f2faeb7799ee => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:56:24 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a3880aef-8481-4589-9084-c72d4858d171 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] Calling method '.version_select at 0x7f364b4e51b0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a3880aef-8481-4589-9084-c72d4858d171 tempest-ServerActionsV293TestJSON-433918882 tempest-ServerActionsV293TestJSON-433918882-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905395609" status: 204 len: 0 microversion: 2.93 time: 0.037003 Nov 27 01:56:24 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 216/638] 10.0.0.210 () {64 vars in 1339 bytes} [Mon Nov 27 01:56:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905395609 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 27 01:56:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:26 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-30ea9775-e3ef-4c7b-8655-2c47753eecd8 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f/action" status: 202 len: 0 microversion: 2.87 time: 0.102431 Nov 27 01:56:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 213/639] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 01:56:26 2023] POST /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:56:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:26 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-15ce2484-bc0a-4d6e-8ff1-f9026f57236c req-47172e6a-86ef-4d4a-8a63-69b7fdcf0bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-plugged", "status": "completed", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-15ce2484-bc0a-4d6e-8ff1-f9026f57236c req-47172e6a-86ef-4d4a-8a63-69b7fdcf0bec service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-15ce2484-bc0a-4d6e-8ff1-f9026f57236c req-47172e6a-86ef-4d4a-8a63-69b7fdcf0bec service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-15ce2484-bc0a-4d6e-8ff1-f9026f57236c req-47172e6a-86ef-4d4a-8a63-69b7fdcf0bec service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:27 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:27 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-15ce2484-bc0a-4d6e-8ff1-f9026f57236c req-47172e6a-86ef-4d4a-8a63-69b7fdcf0bec service nova] Creating event network-vif-plugged:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:56:27 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-15ce2484-bc0a-4d6e-8ff1-f9026f57236c req-47172e6a-86ef-4d4a-8a63-69b7fdcf0bec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057208 Nov 27 01:56:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 217/640] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:27 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0d5080d6-9f40-4281-893f-4ecd2d7f87b9 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 200 len: 1762 microversion: 2.87 time: 0.402711 Nov 27 01:56:27 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 211/641] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:56:26 2023] GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 1762 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:56:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-c1dfe0e7-da24-4c9f-b043-9ada3cd8d503 req-5ddcee2f-67ef-4907-a8e5-70805220a2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-unplugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c1dfe0e7-da24-4c9f-b043-9ada3cd8d503 req-5ddcee2f-67ef-4907-a8e5-70805220a2a9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c1dfe0e7-da24-4c9f-b043-9ada3cd8d503 req-5ddcee2f-67ef-4907-a8e5-70805220a2a9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c1dfe0e7-da24-4c9f-b043-9ada3cd8d503 req-5ddcee2f-67ef-4907-a8e5-70805220a2a9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c1dfe0e7-da24-4c9f-b043-9ada3cd8d503 req-5ddcee2f-67ef-4907-a8e5-70805220a2a9 service nova] Creating event network-vif-unplugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:56:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-c1dfe0e7-da24-4c9f-b043-9ada3cd8d503 req-5ddcee2f-67ef-4907-a8e5-70805220a2a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035135 Nov 27 01:56:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 214/642] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:29 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-373cf148-c0dc-427c-8449-cd6547545092 req-9baf1c0d-cf7e-4f5a-b4aa-000532528dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-plugged", "status": "completed", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-373cf148-c0dc-427c-8449-cd6547545092 req-9baf1c0d-cf7e-4f5a-b4aa-000532528dcc service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-373cf148-c0dc-427c-8449-cd6547545092 req-9baf1c0d-cf7e-4f5a-b4aa-000532528dcc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-373cf148-c0dc-427c-8449-cd6547545092 req-9baf1c0d-cf7e-4f5a-b4aa-000532528dcc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-373cf148-c0dc-427c-8449-cd6547545092 req-9baf1c0d-cf7e-4f5a-b4aa-000532528dcc service nova] Creating event network-vif-plugged:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:56:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-373cf148-c0dc-427c-8449-cd6547545092 req-9baf1c0d-cf7e-4f5a-b4aa-000532528dcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034133 Nov 27 01:56:29 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 218/643] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:56:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-f693eda7-9b77-4448-8b29-864486e485a1 req-7c5b6b58-d572-415f-a23a-2d5050c689f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}, {"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f693eda7-9b77-4448-8b29-864486e485a1 req-7c5b6b58-d572-415f-a23a-2d5050c689f2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f693eda7-9b77-4448-8b29-864486e485a1 req-7c5b6b58-d572-415f-a23a-2d5050c689f2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f693eda7-9b77-4448-8b29-864486e485a1 req-7c5b6b58-d572-415f-a23a-2d5050c689f2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-f693eda7-9b77-4448-8b29-864486e485a1 req-7c5b6b58-d572-415f-a23a-2d5050c689f2 service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:56:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-f693eda7-9b77-4448-8b29-864486e485a1 req-7c5b6b58-d572-415f-a23a-2d5050c689f2 service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:56:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-f693eda7-9b77-4448-8b29-864486e485a1 req-7c5b6b58-d572-415f-a23a-2d5050c689f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063734 Nov 27 01:56:30 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 212/644] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:32 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-5916537d-6e02-4e30-a07a-5caf41aaf5bd req-5ce1f103-f43b-4e52-ba3a-355e8af86c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5916537d-6e02-4e30-a07a-5caf41aaf5bd req-5ce1f103-f43b-4e52-ba3a-355e8af86c93 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5916537d-6e02-4e30-a07a-5caf41aaf5bd req-5ce1f103-f43b-4e52-ba3a-355e8af86c93 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5916537d-6e02-4e30-a07a-5caf41aaf5bd req-5ce1f103-f43b-4e52-ba3a-355e8af86c93 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-5916537d-6e02-4e30-a07a-5caf41aaf5bd req-5ce1f103-f43b-4e52-ba3a-355e8af86c93 service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 01:56:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-5916537d-6e02-4e30-a07a-5caf41aaf5bd req-5ce1f103-f43b-4e52-ba3a-355e8af86c93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043485 Nov 27 01:56:32 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 215/645] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:36 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:36 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d3d703da-d113-4622-8201-3279ac3367f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1661 microversion: 2.1 time: 0.218774 Nov 27 01:56:36 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 219/646] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:56:35 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1661 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7b55384-ce77-4dc9-93e2-50713115b4a1"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0111c66e-2616-449a-a1b4-9e9dd2178c37 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301636 Nov 27 01:56:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 213/647] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:56:36 2023] POST /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:41 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-8a49335f-eefe-45d7-9a38-ba14abcb4a4a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1431 microversion: 2.1 time: 0.361647 Nov 27 01:56:41 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 216/648] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:56:41 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1431 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=12 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Old instance type m1.tiny, new instance type m1.small {{(pid=65194) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Getting quotas for project c7a5273d2eb24e2598a4e7d6dc2a4d5c. Resources: {'cores', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Getting quotas for user f4303689d56b490b9a71fc41cb1346bb and project c7a5273d2eb24e2598a4e7d6dc2a4d5c. Resources: {'cores', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:56:46 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:56:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-bc136b89-fd88-4344-adba-3d7245db01d2 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/action" status: 202 len: 0 microversion: 2.1 time: 0.304651 Nov 27 01:56:46 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 220/649] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:56:46 2023] POST /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:46 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:46 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-92510805-c958-49dd-a08f-4a696824a174 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1716 microversion: 2.1 time: 0.205834 Nov 27 01:56:46 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 214/650] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:56:46 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1716 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:56:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0e558501-3e50-48db-a91c-8374f41b66e9 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0e558501-3e50-48db-a91c-8374f41b66e9 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0e558501-3e50-48db-a91c-8374f41b66e9 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0e558501-3e50-48db-a91c-8374f41b66e9 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:48 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0e558501-3e50-48db-a91c-8374f41b66e9 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Going to try to start instance {{(pid=65192) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 27 01:56:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-0e558501-3e50-48db-a91c-8374f41b66e9 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/action" status: 202 len: 0 microversion: 2.1 time: 0.106101 Nov 27 01:56:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 217/651] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:56:48 2023] POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:48 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:48 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-7bb3e073-84f3-4c6c-9304-d7714d899ab1 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1694 microversion: 2.1 time: 0.278116 Nov 27 01:56:48 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 221/652] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:56:48 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1694 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:56:49 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-8c789dad-7591-49c7-a36c-8754fab2f1eb req-581e0e5e-3eec-458f-a8e1-a08d668b8f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-unplugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8c789dad-7591-49c7-a36c-8754fab2f1eb req-581e0e5e-3eec-458f-a8e1-a08d668b8f08 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8c789dad-7591-49c7-a36c-8754fab2f1eb req-581e0e5e-3eec-458f-a8e1-a08d668b8f08 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8c789dad-7591-49c7-a36c-8754fab2f1eb req-581e0e5e-3eec-458f-a8e1-a08d668b8f08 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8c789dad-7591-49c7-a36c-8754fab2f1eb req-581e0e5e-3eec-458f-a8e1-a08d668b8f08 service nova] Creating event network-vif-unplugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:56:49 user devstack@n-api.service[65193]: DEBUG nova.compute.api [req-8c789dad-7591-49c7-a36c-8754fab2f1eb req-581e0e5e-3eec-458f-a8e1-a08d668b8f08 service nova] Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65193) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:56:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-8c789dad-7591-49c7-a36c-8754fab2f1eb req-581e0e5e-3eec-458f-a8e1-a08d668b8f08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043532 Nov 27 01:56:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 215/653] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:50 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 while it is in vm_state rescued Nov 27 01:56:50 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Returning 409 to user: Cannot 'detach_volume' instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 while it is in vm_state rescued {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:56:50 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9062b201-2a05-4e5e-a74c-403e11707ec7 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments/606828a7-ce62-441e-bef2-2b06b7c18321" status: 409 len: 152 microversion: 2.1 time: 0.113106 Nov 27 01:56:50 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 218/654] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:56:50 2023] DELETE /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments/606828a7-ce62-441e-bef2-2b06b7c18321 => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 27 01:56:50 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:50 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-af2537aa-f530-4820-88b5-9d6ed0d8e93f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/action" status: 202 len: 0 microversion: 2.1 time: 0.081622 Nov 27 01:56:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 222/655] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:56:50 2023] POST /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:50 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:56:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ac6d82f4-d626-48ae-b28d-2415229dc14b tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 200 len: 1709 microversion: 2.1 time: 0.242186 Nov 27 01:56:50 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 216/656] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:56:50 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 1709 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:56:51 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6a4c1c33-524b-47bf-9ec2-d0c816f891b0 req-b7de191f-f377-4c35-aded-ca9babfda1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6a4c1c33-524b-47bf-9ec2-d0c816f891b0 req-b7de191f-f377-4c35-aded-ca9babfda1e5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6a4c1c33-524b-47bf-9ec2-d0c816f891b0 req-b7de191f-f377-4c35-aded-ca9babfda1e5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6a4c1c33-524b-47bf-9ec2-d0c816f891b0 req-b7de191f-f377-4c35-aded-ca9babfda1e5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6a4c1c33-524b-47bf-9ec2-d0c816f891b0 req-b7de191f-f377-4c35-aded-ca9babfda1e5 service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:56:51 user devstack@n-api.service[65192]: DEBUG nova.compute.api [req-6a4c1c33-524b-47bf-9ec2-d0c816f891b0 req-b7de191f-f377-4c35-aded-ca9babfda1e5 service nova] Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65192) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:56:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6a4c1c33-524b-47bf-9ec2-d0c816f891b0 req-b7de191f-f377-4c35-aded-ca9babfda1e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064974 Nov 27 01:56:51 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 219/657] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-db4a623f-4e13-430c-a43d-8973facde7b0 req-e675fe63-91d2-449d-9418-772264aa5f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-unplugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}, {"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-db4a623f-4e13-430c-a43d-8973facde7b0 req-e675fe63-91d2-449d-9418-772264aa5f09 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-db4a623f-4e13-430c-a43d-8973facde7b0 req-e675fe63-91d2-449d-9418-772264aa5f09 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-db4a623f-4e13-430c-a43d-8973facde7b0 req-e675fe63-91d2-449d-9418-772264aa5f09 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-db4a623f-4e13-430c-a43d-8973facde7b0 req-e675fe63-91d2-449d-9418-772264aa5f09 service nova] Creating event network-vif-unplugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:56:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-db4a623f-4e13-430c-a43d-8973facde7b0 req-e675fe63-91d2-449d-9418-772264aa5f09 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:56:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-db4a623f-4e13-430c-a43d-8973facde7b0 req-e675fe63-91d2-449d-9418-772264aa5f09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036145 Nov 27 01:56:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 223/658] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:53 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:55 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-22019f49-6eb5-4107-a136-6a415966b313 req-f10c4172-9c54-49ca-9522-54e3d62e35e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-22019f49-6eb5-4107-a136-6a415966b313 req-f10c4172-9c54-49ca-9522-54e3d62e35e1 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-22019f49-6eb5-4107-a136-6a415966b313 req-f10c4172-9c54-49ca-9522-54e3d62e35e1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-22019f49-6eb5-4107-a136-6a415966b313 req-f10c4172-9c54-49ca-9522-54e3d62e35e1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-22019f49-6eb5-4107-a136-6a415966b313 req-f10c4172-9c54-49ca-9522-54e3d62e35e1 service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:56:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-22019f49-6eb5-4107-a136-6a415966b313 req-f10c4172-9c54-49ca-9522-54e3d62e35e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054627 Nov 27 01:56:55 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 217/659] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-dbdb3865-ce21-4060-a5b6-611fafb0a3af req-545ed058-5226-4da0-92fa-c8c78345c496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}, {"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-dbdb3865-ce21-4060-a5b6-611fafb0a3af req-545ed058-5226-4da0-92fa-c8c78345c496 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-dbdb3865-ce21-4060-a5b6-611fafb0a3af req-545ed058-5226-4da0-92fa-c8c78345c496 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-dbdb3865-ce21-4060-a5b6-611fafb0a3af req-545ed058-5226-4da0-92fa-c8c78345c496 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-dbdb3865-ce21-4060-a5b6-611fafb0a3af req-545ed058-5226-4da0-92fa-c8c78345c496 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:56:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-dbdb3865-ce21-4060-a5b6-611fafb0a3af req-545ed058-5226-4da0-92fa-c8c78345c496 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:56:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-dbdb3865-ce21-4060-a5b6-611fafb0a3af req-545ed058-5226-4da0-92fa-c8c78345c496 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074914 Nov 27 01:56:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 220/660] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:56:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-54276c6e-36b3-436a-ae6e-6d7330ae52a2 req-f4c717f8-1a0e-4303-9061-af434e135b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:56:57 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:56:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-54276c6e-36b3-436a-ae6e-6d7330ae52a2 req-f4c717f8-1a0e-4303-9061-af434e135b3a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:56:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-54276c6e-36b3-436a-ae6e-6d7330ae52a2 req-f4c717f8-1a0e-4303-9061-af434e135b3a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:56:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-54276c6e-36b3-436a-ae6e-6d7330ae52a2 req-f4c717f8-1a0e-4303-9061-af434e135b3a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:56:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-54276c6e-36b3-436a-ae6e-6d7330ae52a2 req-f4c717f8-1a0e-4303-9061-af434e135b3a service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:56:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-54276c6e-36b3-436a-ae6e-6d7330ae52a2 req-f4c717f8-1a0e-4303-9061-af434e135b3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037551 Nov 27 01:56:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 224/661] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:56:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:04 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-f209752c-9063-4728-8acd-facdbf194b19 req-c5044397-d899-465f-a93d-ebd7c890a5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f209752c-9063-4728-8acd-facdbf194b19 req-c5044397-d899-465f-a93d-ebd7c890a5cd service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f209752c-9063-4728-8acd-facdbf194b19 req-c5044397-d899-465f-a93d-ebd7c890a5cd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f209752c-9063-4728-8acd-facdbf194b19 req-c5044397-d899-465f-a93d-ebd7c890a5cd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:04 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-f209752c-9063-4728-8acd-facdbf194b19 req-c5044397-d899-465f-a93d-ebd7c890a5cd service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:57:04 user devstack@n-api.service[65193]: DEBUG nova.compute.api [req-f209752c-9063-4728-8acd-facdbf194b19 req-c5044397-d899-465f-a93d-ebd7c890a5cd service nova] Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65193) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:57:04 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-f209752c-9063-4728-8acd-facdbf194b19 req-c5044397-d899-465f-a93d-ebd7c890a5cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056071 Nov 27 01:57:04 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 218/662] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:06 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:06 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:06 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-61846e74-86c1-4751-8fea-abec429d390a req-0ce31f88-b27f-4a51-99dd-33e251089a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-61846e74-86c1-4751-8fea-abec429d390a req-0ce31f88-b27f-4a51-99dd-33e251089a16 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-61846e74-86c1-4751-8fea-abec429d390a req-0ce31f88-b27f-4a51-99dd-33e251089a16 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-61846e74-86c1-4751-8fea-abec429d390a req-0ce31f88-b27f-4a51-99dd-33e251089a16 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:06 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-61846e74-86c1-4751-8fea-abec429d390a req-0ce31f88-b27f-4a51-99dd-33e251089a16 service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:57:06 user devstack@n-api.service[65192]: DEBUG nova.compute.api [req-61846e74-86c1-4751-8fea-abec429d390a req-0ce31f88-b27f-4a51-99dd-33e251089a16 service nova] Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65192) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:57:06 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-61846e74-86c1-4751-8fea-abec429d390a req-0ce31f88-b27f-4a51-99dd-33e251089a16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063845 Nov 27 01:57:06 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 221/663] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=22 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:11 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-08290989-83de-48cd-aebb-f6589bdb280a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1534 microversion: 2.1 time: 0.280930 Nov 27 01:57:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 225/664] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:57:11 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1534 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=10 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=22 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:17 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-218a2332-f969-4275-8847-9dedceb1e6de tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 200 len: 1768 microversion: 2.87 time: 0.345767 Nov 27 01:57:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 219/665] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:57:17 2023] GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 1768 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-eb841835-c93f-4d4a-9bb0-c89684302bdb tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049658 Nov 27 01:57:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 222/666] 10.0.0.210 () {64 vars in 1420 bytes} [Mon Nov 27 01:57:21 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:21 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:57:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6742d96e-1466-4610-a88f-46b48a3fe0b7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 204 len: 0 microversion: 2.20 time: 0.137511 Nov 27 01:57:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 226/667] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:57:21 2023] DELETE /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:21 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f1bb99a4d784d28abed0c4dcc03fc03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0890368fe814dd5b4370275a3d0420f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:21 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-e3fbe328-b056-4ce4-bbdf-86d82ea4ee16 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 200 len: 1709 microversion: 2.20 time: 0.307967 Nov 27 01:57:21 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 220/668] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:57:21 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 1709 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-88d2d49d-6706-41a5-8deb-864aef567b34 req-fbd3cc60-c8f4-43b9-b884-0c30ea406706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-unplugged", "status": "completed", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-88d2d49d-6706-41a5-8deb-864aef567b34 req-fbd3cc60-c8f4-43b9-b884-0c30ea406706 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-88d2d49d-6706-41a5-8deb-864aef567b34 req-fbd3cc60-c8f4-43b9-b884-0c30ea406706 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-88d2d49d-6706-41a5-8deb-864aef567b34 req-fbd3cc60-c8f4-43b9-b884-0c30ea406706 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-88d2d49d-6706-41a5-8deb-864aef567b34 req-fbd3cc60-c8f4-43b9-b884-0c30ea406706 service nova] Creating event network-vif-unplugged:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:57:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-88d2d49d-6706-41a5-8deb-864aef567b34 req-fbd3cc60-c8f4-43b9-b884-0c30ea406706 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037093 Nov 27 01:57:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 223/669] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:23 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-9a7e69e4-f7b3-4d03-8380-0297e242e230 req-efe19f50-d6f8-4ac8-abdc-d2ffa9893788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-plugged", "status": "completed", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9a7e69e4-f7b3-4d03-8380-0297e242e230 req-efe19f50-d6f8-4ac8-abdc-d2ffa9893788 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9a7e69e4-f7b3-4d03-8380-0297e242e230 req-efe19f50-d6f8-4ac8-abdc-d2ffa9893788 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9a7e69e4-f7b3-4d03-8380-0297e242e230 req-efe19f50-d6f8-4ac8-abdc-d2ffa9893788 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:23 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-77651352-1417-472b-97dc-aa77d239e285 req-3b8d08bb-a8d3-4ccf-8635-c8ea93f07c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb4f4de-56ea-4821-b96b-4fc4a9493acc", "name": "network-vif-deleted", "tag": "773a5f14-6792-4eb7-8e9a-370a9ff0d629"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-9a7e69e4-f7b3-4d03-8380-0297e242e230 req-efe19f50-d6f8-4ac8-abdc-d2ffa9893788 service nova] Creating event network-vif-plugged:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:57:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-77651352-1417-472b-97dc-aa77d239e285 req-3b8d08bb-a8d3-4ccf-8635-c8ea93f07c9d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-9a7e69e4-f7b3-4d03-8380-0297e242e230 req-efe19f50-d6f8-4ac8-abdc-d2ffa9893788 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067114 Nov 27 01:57:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-77651352-1417-472b-97dc-aa77d239e285 req-3b8d08bb-a8d3-4ccf-8635-c8ea93f07c9d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-77651352-1417-472b-97dc-aa77d239e285 req-3b8d08bb-a8d3-4ccf-8635-c8ea93f07c9d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:23 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 227/670] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-77651352-1417-472b-97dc-aa77d239e285 req-3b8d08bb-a8d3-4ccf-8635-c8ea93f07c9d service nova] Creating event network-vif-deleted:773a5f14-6792-4eb7-8e9a-370a9ff0d629 for instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc on user Nov 27 01:57:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-77651352-1417-472b-97dc-aa77d239e285 req-3b8d08bb-a8d3-4ccf-8635-c8ea93f07c9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044709 Nov 27 01:57:23 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 221/671] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=12 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:37 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:37 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d8e1f335-0cb0-4f1f-83dc-db98b3df996d tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1715 microversion: 2.1 time: 0.314273 Nov 27 01:57:37 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 224/672] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:57:36 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1715 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:39 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-38b20d67-0bd4-4251-8d45-23cae2a02690 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1698 microversion: 2.1 time: 0.196744 Nov 27 01:57:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 228/673] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:57:39 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1698 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=8 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=14 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:40 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-17f8f86e-4a64-4f4c-a317-28b6008fb841 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 200 len: 1715 microversion: 2.1 time: 0.208050 Nov 27 01:57:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 222/674] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:57:40 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 1715 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:57:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-71296cf0-fcd0-4f94-a107-3414957c36ef tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.148646 Nov 27 01:57:41 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 225/675] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:57:41 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7/os-interface => generated 283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-de069837-60f5-4c92-8115-dbca3e5633e1 req-51c54171-62b9-4f4a-862f-217e5ca19944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163993f6-3b37-40ff-9372-37f866d28180", "tag": "2e93035c-a4c4-44f1-af80-c57fb2da8038"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-de069837-60f5-4c92-8115-dbca3e5633e1 req-51c54171-62b9-4f4a-862f-217e5ca19944 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-de069837-60f5-4c92-8115-dbca3e5633e1 req-51c54171-62b9-4f4a-862f-217e5ca19944 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-de069837-60f5-4c92-8115-dbca3e5633e1 req-51c54171-62b9-4f4a-862f-217e5ca19944 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-de069837-60f5-4c92-8115-dbca3e5633e1 req-51c54171-62b9-4f4a-862f-217e5ca19944 service nova] Creating event network-changed:2e93035c-a4c4-44f1-af80-c57fb2da8038 for instance 163993f6-3b37-40ff-9372-37f866d28180 on user Nov 27 01:57:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-de069837-60f5-4c92-8115-dbca3e5633e1 req-51c54171-62b9-4f4a-862f-217e5ca19944 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035744 Nov 27 01:57:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 229/676] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:43 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3d60f9fd-dbe0-462e-a085-4a7fe255d4ea tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1431 microversion: 2.1 time: 0.256372 Nov 27 01:57:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 223/677] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:57:43 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1431 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Old instance type m1.tiny, new instance type m1.small {{(pid=65192) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:44 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'cores', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:57:44 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Getting quotas for user 4d1d312ea9224e4b9e57e5576276a485 and project 25a6f8db8baf4e9988fc1ca048107122. Resources: {'cores', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:57:44 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:57:44 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:57:44 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:57:44 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:57:44 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:57:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ec4973e6-18a0-4c33-a9ab-70bb8eeb2f00 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7/action" status: 202 len: 0 microversion: 2.1 time: 0.455836 Nov 27 01:57:44 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 226/678] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:57:43 2023] POST /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:44 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:57:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-11d2f854-85a1-4ad3-946a-27201ef4a5aa tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1440 microversion: 2.1 time: 0.155082 Nov 27 01:57:44 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 230/679] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:57:44 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1440 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:57:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d571794d-7fc0-401a-b983-476a705c51d0 req-1d9c7dc6-b4dd-4187-8a36-874f755a2021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d571794d-7fc0-401a-b983-476a705c51d0 req-1d9c7dc6-b4dd-4187-8a36-874f755a2021 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d571794d-7fc0-401a-b983-476a705c51d0 req-1d9c7dc6-b4dd-4187-8a36-874f755a2021 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d571794d-7fc0-401a-b983-476a705c51d0 req-1d9c7dc6-b4dd-4187-8a36-874f755a2021 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d571794d-7fc0-401a-b983-476a705c51d0 req-1d9c7dc6-b4dd-4187-8a36-874f755a2021 service nova] Creating event network-changed:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 01:57:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-d571794d-7fc0-401a-b983-476a705c51d0 req-1d9c7dc6-b4dd-4187-8a36-874f755a2021 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040024 Nov 27 01:57:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 224/680] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:47 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-798b43f5-af5f-4c34-9301-a357c183167f req-9b906f61-0e72-4050-ab11-d67c03f640e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-unplugged", "status": "completed", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}, {"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-plugged", "status": "completed", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-798b43f5-af5f-4c34-9301-a357c183167f req-9b906f61-0e72-4050-ab11-d67c03f640e9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-798b43f5-af5f-4c34-9301-a357c183167f req-9b906f61-0e72-4050-ab11-d67c03f640e9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-798b43f5-af5f-4c34-9301-a357c183167f req-9b906f61-0e72-4050-ab11-d67c03f640e9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-798b43f5-af5f-4c34-9301-a357c183167f req-9b906f61-0e72-4050-ab11-d67c03f640e9 service nova] Creating event network-vif-unplugged:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 01:57:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-798b43f5-af5f-4c34-9301-a357c183167f req-9b906f61-0e72-4050-ab11-d67c03f640e9 service nova] Creating event network-vif-plugged:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 01:57:47 user devstack@n-api.service[65192]: DEBUG nova.compute.api [req-798b43f5-af5f-4c34-9301-a357c183167f req-9b906f61-0e72-4050-ab11-d67c03f640e9 service nova] Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65192) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:57:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-798b43f5-af5f-4c34-9301-a357c183167f req-9b906f61-0e72-4050-ab11-d67c03f640e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.052509 Nov 27 01:57:47 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 227/681] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:47 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:57:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-34cc5b87-516b-4f55-972c-a4f68438ed47 req-9157a177-08b9-4904-beff-7790d18c88a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-plugged", "status": "completed", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:57:59 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:59 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=14 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:57:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-34cc5b87-516b-4f55-972c-a4f68438ed47 req-9157a177-08b9-4904-beff-7790d18c88a8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:57:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-34cc5b87-516b-4f55-972c-a4f68438ed47 req-9157a177-08b9-4904-beff-7790d18c88a8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:57:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-34cc5b87-516b-4f55-972c-a4f68438ed47 req-9157a177-08b9-4904-beff-7790d18c88a8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:57:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-34cc5b87-516b-4f55-972c-a4f68438ed47 req-9157a177-08b9-4904-beff-7790d18c88a8 service nova] Creating event network-vif-plugged:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 01:57:59 user devstack@n-api.service[65194]: DEBUG nova.compute.api [req-34cc5b87-516b-4f55-972c-a4f68438ed47 req-9157a177-08b9-4904-beff-7790d18c88a8 service nova] Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65194) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:57:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-34cc5b87-516b-4f55-972c-a4f68438ed47 req-9157a177-08b9-4904-beff-7790d18c88a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055421 Nov 27 01:57:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 231/682] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:57:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=14 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:01 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-646444bc-8056-4eff-b525-590fa739e318 req-8c5f134e-80a6-491c-a7b9-62e65bf69529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-plugged", "status": "completed", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-646444bc-8056-4eff-b525-590fa739e318 req-8c5f134e-80a6-491c-a7b9-62e65bf69529 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-646444bc-8056-4eff-b525-590fa739e318 req-8c5f134e-80a6-491c-a7b9-62e65bf69529 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-646444bc-8056-4eff-b525-590fa739e318 req-8c5f134e-80a6-491c-a7b9-62e65bf69529 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-646444bc-8056-4eff-b525-590fa739e318 req-8c5f134e-80a6-491c-a7b9-62e65bf69529 service nova] Creating event network-vif-plugged:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 01:58:01 user devstack@n-api.service[65193]: DEBUG nova.compute.api [req-646444bc-8056-4eff-b525-590fa739e318 req-8c5f134e-80a6-491c-a7b9-62e65bf69529 service nova] Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65193) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:58:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-646444bc-8056-4eff-b525-590fa739e318 req-8c5f134e-80a6-491c-a7b9-62e65bf69529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053399 Nov 27 01:58:01 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 225/683] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=20 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-6bd55927-6014-43be-ada2-f4359653a931 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1534 microversion: 2.1 time: 0.217716 Nov 27 01:58:11 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 228/684] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:58:11 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1534 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:58:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] HTTP exception thrown: Instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc could not be found. Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Returning 404 to user: Instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:58:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-78e6b344-1cfd-4f66-b4d0-549f1cb3066b tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 404 len: 111 microversion: 2.20 time: 0.033658 Nov 27 01:58:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 232/685] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:58:11 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:58:11 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-b9c7f252-b8a5-47ea-9a37-7a9d13b95169 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '.version_select at 0x7f364b69d510>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:11 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:11 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Searching by: {'deleted': False, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881'} {{(pid=65192) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-b9c7f252-b8a5-47ea-9a37-7a9d13b95169 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-461329308" status: 204 len: 0 microversion: 2.20 time: 0.026386 Nov 27 01:58:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 226/686] 10.0.0.210 () {64 vars in 1336 bytes} [Mon Nov 27 01:58:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-461329308 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:11 user devstack@n-api.service[65192]: DEBUG nova.compute.multi_cell_list [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65192) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 01:58:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b169c89c-d83d-4c3a-974b-a790dbbf6afb tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.113089 Nov 27 01:58:11 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 229/687] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Nov 27 01:58:11 2023] GET /compute/v2.1/servers => generated 341 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:12 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-890f56cc-2962-489f-be2b-fc1ba5390fed tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1534 microversion: 2.1 time: 0.286844 Nov 27 01:58:12 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 233/688] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:58:11 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1534 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:58:14 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff2984a-8180-430f-a66c-0b21b1688782"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:14 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:14 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-770e076a-1219-4e2c-ad2e-263b8d9a5123 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346323 Nov 27 01:58:15 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 227/689] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 01:58:14 2023] POST /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:15 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] HTTP exception thrown: Instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc could not be found. Nov 27 01:58:16 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Returning 404 to user: Instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:58:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-aae8f9eb-df37-4946-9914-a6d2b2f00d2d tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 404 len: 111 microversion: 2.20 time: 0.037111 Nov 27 01:58:16 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 230/690] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:58:15 2023] DELETE /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: 9cb4f4de-56ea-4821-b96b-4fc4a9493acc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:16 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] HTTP exception thrown: Instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc could not be found. Nov 27 01:58:16 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Returning 404 to user: Instance 9cb4f4de-56ea-4821-b96b-4fc4a9493acc could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:58:16 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-7977b10a-f21a-409e-9401-860b0ad891a0 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc" status: 404 len: 111 microversion: 2.20 time: 0.027482 Nov 27 01:58:16 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 234/691] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:58:16 2023] GET /compute/v2.1/servers/9cb4f4de-56ea-4821-b96b-4fc4a9493acc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:58:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-592566019", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "0674729f-c03e-4bfb-bfbe-32ac4c167bcf"}]}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:17 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] validate_networks() for [('0674729f-c03e-4bfb-bfbe-32ac4c167bcf', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Getting quotas for project b168d75a030e425886b18204a7173843. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Getting quotas for user 357d7d579c284bcd836dd8075476d5ed and project b168d75a030e425886b18204a7173843. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:58:18 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:58:18 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-cf0900dd-a6c7-4250-9ee0-1791d3194e8e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.765258 Nov 27 01:58:18 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 228/692] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Nov 27 01:58:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 01:58:18 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-346d9215-b3b3-493d-9a72-2cdd64c2b6c6 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:18 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-346d9215-b3b3-493d-9a72-2cdd64c2b6c6 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:18 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-346d9215-b3b3-493d-9a72-2cdd64c2b6c6 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:18 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-346d9215-b3b3-493d-9a72-2cdd64c2b6c6 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:18 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-346d9215-b3b3-493d-9a72-2cdd64c2b6c6 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-346d9215-b3b3-493d-9a72-2cdd64c2b6c6 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c" status: 200 len: 1394 microversion: 2.87 time: 0.082230 Nov 27 01:58:18 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 231/693] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:58:18 2023] GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c => generated 1394 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] HTTP exception thrown: Instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 could not be found. Nov 27 01:58:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Returning 404 to user: Instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:58:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3dff0518-7589-4620-8d80-cd1338e00096 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 404 len: 111 microversion: 2.20 time: 0.028698 Nov 27 01:58:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 235/694] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 01:58:19 2023] DELETE /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] [instance: ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] HTTP exception thrown: Instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 could not be found. Nov 27 01:58:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] Returning 404 to user: Instance ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 01:58:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-f9394b37-1a0b-4672-9827-a074908454d7 tempest-AttachVolumeShelveTestJSON-989842187 tempest-AttachVolumeShelveTestJSON-989842187-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4" status: 404 len: 111 microversion: 2.20 time: 0.027771 Nov 27 01:58:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 229/695] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:58:19 2023] GET /compute/v2.1/servers/ddeaf5de-01a9-4958-a1ed-b07c25c8d6d4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 01:58:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-9cb34e0b-2078-47d3-8ff9-2421d74c4f74 req-984c99ce-c503-43ca-b8b4-eeb65614a5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11fa880a-3dc3-4455-9d4b-967c16beed5c", "tag": "3a963bef-d949-42df-a116-7049ffc392a8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:22 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9cb34e0b-2078-47d3-8ff9-2421d74c4f74 req-984c99ce-c503-43ca-b8b4-eeb65614a5d8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9cb34e0b-2078-47d3-8ff9-2421d74c4f74 req-984c99ce-c503-43ca-b8b4-eeb65614a5d8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9cb34e0b-2078-47d3-8ff9-2421d74c4f74 req-984c99ce-c503-43ca-b8b4-eeb65614a5d8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-9cb34e0b-2078-47d3-8ff9-2421d74c4f74 req-984c99ce-c503-43ca-b8b4-eeb65614a5d8 service nova] Creating event network-changed:3a963bef-d949-42df-a116-7049ffc392a8 for instance 11fa880a-3dc3-4455-9d4b-967c16beed5c on user Nov 27 01:58:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-9cb34e0b-2078-47d3-8ff9-2421d74c4f74 req-984c99ce-c503-43ca-b8b4-eeb65614a5d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033882 Nov 27 01:58:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 232/696] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-3b74bb24-1018-45ec-87c1-9c48ebe3ba00 req-d3668340-535a-4b52-b81f-b9ff3f7bd152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fa880a-3dc3-4455-9d4b-967c16beed5c", "name": "network-vif-plugged", "status": "completed", "tag": "3a963bef-d949-42df-a116-7049ffc392a8"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3b74bb24-1018-45ec-87c1-9c48ebe3ba00 req-d3668340-535a-4b52-b81f-b9ff3f7bd152 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3b74bb24-1018-45ec-87c1-9c48ebe3ba00 req-d3668340-535a-4b52-b81f-b9ff3f7bd152 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3b74bb24-1018-45ec-87c1-9c48ebe3ba00 req-d3668340-535a-4b52-b81f-b9ff3f7bd152 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-3b74bb24-1018-45ec-87c1-9c48ebe3ba00 req-d3668340-535a-4b52-b81f-b9ff3f7bd152 service nova] Creating event network-vif-plugged:3a963bef-d949-42df-a116-7049ffc392a8 for instance 11fa880a-3dc3-4455-9d4b-967c16beed5c on user Nov 27 01:58:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-3b74bb24-1018-45ec-87c1-9c48ebe3ba00 req-d3668340-535a-4b52-b81f-b9ff3f7bd152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057509 Nov 27 01:58:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 236/697] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:25 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:25 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:26 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a1ef8155-46b4-4620-91ba-1e5f079ab48f tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1580 microversion: 2.1 time: 0.210838 Nov 27 01:58:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 230/698] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:58:25 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1580 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:58:27 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-1eb7536a-1f37-4b4e-99f4-3b239ebdb8c8 req-e195c04d-9fce-4720-a3e1-3b25908a01dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fa880a-3dc3-4455-9d4b-967c16beed5c", "name": "network-vif-plugged", "status": "completed", "tag": "3a963bef-d949-42df-a116-7049ffc392a8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1eb7536a-1f37-4b4e-99f4-3b239ebdb8c8 req-e195c04d-9fce-4720-a3e1-3b25908a01dc service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1eb7536a-1f37-4b4e-99f4-3b239ebdb8c8 req-e195c04d-9fce-4720-a3e1-3b25908a01dc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-1eb7536a-1f37-4b4e-99f4-3b239ebdb8c8 req-e195c04d-9fce-4720-a3e1-3b25908a01dc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-1eb7536a-1f37-4b4e-99f4-3b239ebdb8c8 req-e195c04d-9fce-4720-a3e1-3b25908a01dc service nova] Creating event network-vif-plugged:3a963bef-d949-42df-a116-7049ffc392a8 for instance 11fa880a-3dc3-4455-9d4b-967c16beed5c on user Nov 27 01:58:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-1eb7536a-1f37-4b4e-99f4-3b239ebdb8c8 req-e195c04d-9fce-4720-a3e1-3b25908a01dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032183 Nov 27 01:58:27 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 233/699] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:29 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-ec212a65-80ea-4e97-99e2-1c68769c315e req-3328be83-5840-43ea-93d5-d51e38f515cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ec212a65-80ea-4e97-99e2-1c68769c315e req-3328be83-5840-43ea-93d5-d51e38f515cb service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ec212a65-80ea-4e97-99e2-1c68769c315e req-3328be83-5840-43ea-93d5-d51e38f515cb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ec212a65-80ea-4e97-99e2-1c68769c315e req-3328be83-5840-43ea-93d5-d51e38f515cb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ec212a65-80ea-4e97-99e2-1c68769c315e req-3328be83-5840-43ea-93d5-d51e38f515cb service nova] Creating event network-changed:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:58:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-ec212a65-80ea-4e97-99e2-1c68769c315e req-3328be83-5840-43ea-93d5-d51e38f515cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204273 Nov 27 01:58:29 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 237/700] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1037957923"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:30 user devstack@n-api.service[65193]: INFO nova.network.security_group_api [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Adding security group aab46e17-f04c-400e-87d4-6ba2f5468f4a to port 6bc94eec-248b-4342-bfd1-5df305806d9c Nov 27 01:58:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7adc4bd2-ed13-4860-8ba1-a0ce82cabd0e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/action" status: 202 len: 0 microversion: 2.1 time: 0.947713 Nov 27 01:58:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 231/701] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:58:30 2023] POST /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/action => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-9b7f874d-5851-42bf-99fa-3e7b3a25d47d req-87022fec-28dd-4fe4-a51f-21fe3090bc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9b7f874d-5851-42bf-99fa-3e7b3a25d47d req-87022fec-28dd-4fe4-a51f-21fe3090bc77 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9b7f874d-5851-42bf-99fa-3e7b3a25d47d req-87022fec-28dd-4fe4-a51f-21fe3090bc77 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9b7f874d-5851-42bf-99fa-3e7b3a25d47d req-87022fec-28dd-4fe4-a51f-21fe3090bc77 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-9b7f874d-5851-42bf-99fa-3e7b3a25d47d req-87022fec-28dd-4fe4-a51f-21fe3090bc77 service nova] Creating event network-changed:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:58:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-9b7f874d-5851-42bf-99fa-3e7b3a25d47d req-87022fec-28dd-4fe4-a51f-21fe3090bc77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043371 Nov 27 01:58:31 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 238/702] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-f0563313-7e4c-4fb0-80c2-f5c31d92edd3 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1745 microversion: 2.1 time: 0.435157 Nov 27 01:58:32 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 234/703] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:58:31 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1745 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:58:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:32 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:32 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-5cabc67e-4c4e-4668-a6e8-f83d7344ddf6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: .version_select at 0x7f364b69ef80>, body: {"keypair": {"name": "tempest-keypair-887569923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6qKn5kdfEYJz9ebqCLV9ATZX9Ta6QrHjMGAa2C5/Ii+iaWrigf6PrjxctZ5C5wrvFeay3fVBb9C/6HDMZMh0YHp/Id5s3e4chB93cF12PJ6UmyPSugjtkIxQLdAknhtQ=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-813c6670-5d7e-4b85-b098-8bcf1f354e5a tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/action" status: 202 len: 0 microversion: 2.1 time: 0.086795 Nov 27 01:58:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 239/704] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:58:32 2023] POST /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:32 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-5cabc67e-4c4e-4668-a6e8-f83d7344ddf6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for project 5da185c008a949dca58184441ccb0a41. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:58:32 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-5cabc67e-4c4e-4668-a6e8-f83d7344ddf6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for user 82943dfd9046457e9f82f89cba00ff18 and project 5da185c008a949dca58184441ccb0a41. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:58:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-5cabc67e-4c4e-4668-a6e8-f83d7344ddf6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184278 Nov 27 01:58:32 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 232/705] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 01:58:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:32 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7e7304e6-18b5-40b5-a3da-528c56f4b223 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1737 microversion: 2.1 time: 0.210969 Nov 27 01:58:32 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 235/706] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:58:32 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-671162978", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e82e28e4-25ab-4f21-9e45-49763803697d"}], "security_groups": [{"name": "tempest-securitygroup--2004174784"}], "key_name": "tempest-keypair-887569923", "user_data": "}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] validate_networks() for [('e82e28e4-25ab-4f21-9e45-49763803697d', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:34 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-56c9d2ec-d64d-4420-b2f8-724445ff69a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1558 microversion: 2.1 time: 0.255000 Nov 27 01:58:34 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 233/707] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:58:34 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for project 5da185c008a949dca58184441ccb0a41. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for user 82943dfd9046457e9f82f89cba00ff18 and project 5da185c008a949dca58184441ccb0a41. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 01:58:34 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 01:58:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b5f1664f-65c5-431d-a1b4-a3978587ca0e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.704605 Nov 27 01:58:34 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 240/708] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 01:58:34 2023] POST /compute/v2.1/servers => generated 400 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 01:58:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-effe54a5-1fb9-454a-8a68-219da6d74892 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:34 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-effe54a5-1fb9-454a-8a68-219da6d74892 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:34 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-effe54a5-1fb9-454a-8a68-219da6d74892 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-effe54a5-1fb9-454a-8a68-219da6d74892 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106" status: 200 len: 1232 microversion: 2.1 time: 0.067945 Nov 27 01:58:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 236/709] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:58:34 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106 => generated 1232 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:58:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d0d92968-de2f-4df1-9231-f2ded20836e9 req-69aed85d-ca57-4687-a13f-1bf6c103a734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-unplugged", "status": "completed", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d0d92968-de2f-4df1-9231-f2ded20836e9 req-69aed85d-ca57-4687-a13f-1bf6c103a734 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d0d92968-de2f-4df1-9231-f2ded20836e9 req-69aed85d-ca57-4687-a13f-1bf6c103a734 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d0d92968-de2f-4df1-9231-f2ded20836e9 req-69aed85d-ca57-4687-a13f-1bf6c103a734 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d0d92968-de2f-4df1-9231-f2ded20836e9 req-69aed85d-ca57-4687-a13f-1bf6c103a734 service nova] Creating event network-vif-unplugged:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:58:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-d0d92968-de2f-4df1-9231-f2ded20836e9 req-69aed85d-ca57-4687-a13f-1bf6c103a734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041805 Nov 27 01:58:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 234/710] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:37 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:37 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:37 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-fed49882-14b2-453e-a894-86b52a308010 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/action" status: 202 len: 0 microversion: 2.1 time: 0.303815 Nov 27 01:58:37 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 241/711] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:58:37 2023] POST /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:37 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-7e28f903-4f0e-4574-a15f-88baa8d87a19 req-5987d637-bae5-4b16-b565-77e7fc085a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-plugged", "status": "completed", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7e28f903-4f0e-4574-a15f-88baa8d87a19 req-5987d637-bae5-4b16-b565-77e7fc085a1a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7e28f903-4f0e-4574-a15f-88baa8d87a19 req-5987d637-bae5-4b16-b565-77e7fc085a1a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7e28f903-4f0e-4574-a15f-88baa8d87a19 req-5987d637-bae5-4b16-b565-77e7fc085a1a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:37 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:58:37 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7e28f903-4f0e-4574-a15f-88baa8d87a19 req-5987d637-bae5-4b16-b565-77e7fc085a1a service nova] Creating event network-vif-plugged:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:58:37 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-f4a5b43d-658e-4b52-aa2b-2bfafa399ced tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1714 microversion: 2.1 time: 0.291938 Nov 27 01:58:37 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 237/712] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:58:37 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1714 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:58:37 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-7e28f903-4f0e-4574-a15f-88baa8d87a19 req-5987d637-bae5-4b16-b565-77e7fc085a1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056963 Nov 27 01:58:37 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 235/713] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d127c4bf-2c00-465a-a376-7a8dc6d3f5fd req-efbad330-7f99-44fa-8499-eb94bd3afcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-unplugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d127c4bf-2c00-465a-a376-7a8dc6d3f5fd req-efbad330-7f99-44fa-8499-eb94bd3afcfd service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d127c4bf-2c00-465a-a376-7a8dc6d3f5fd req-efbad330-7f99-44fa-8499-eb94bd3afcfd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d127c4bf-2c00-465a-a376-7a8dc6d3f5fd req-efbad330-7f99-44fa-8499-eb94bd3afcfd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d127c4bf-2c00-465a-a376-7a8dc6d3f5fd req-efbad330-7f99-44fa-8499-eb94bd3afcfd service nova] Creating event network-vif-unplugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:58:39 user devstack@n-api.service[65194]: DEBUG nova.compute.api [req-d127c4bf-2c00-465a-a376-7a8dc6d3f5fd req-efbad330-7f99-44fa-8499-eb94bd3afcfd service nova] Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65194) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:58:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d127c4bf-2c00-465a-a376-7a8dc6d3f5fd req-efbad330-7f99-44fa-8499-eb94bd3afcfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041684 Nov 27 01:58:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 242/714] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:39 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-04c7d45e-71f0-4ed9-8518-ff3c89a255e0 req-569a0ad5-fcf5-4895-b915-b9d5a235250b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749cda36-ac85-44a0-836a-e7b9cea6f106", "tag": "61e70911-2ed9-4794-ad68-81c843623a01"}, {"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-plugged", "status": "completed", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}, {"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-plugged", "status": "completed", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-04c7d45e-71f0-4ed9-8518-ff3c89a255e0 req-569a0ad5-fcf5-4895-b915-b9d5a235250b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-04c7d45e-71f0-4ed9-8518-ff3c89a255e0 req-569a0ad5-fcf5-4895-b915-b9d5a235250b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:39 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-04c7d45e-71f0-4ed9-8518-ff3c89a255e0 req-569a0ad5-fcf5-4895-b915-b9d5a235250b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:39 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lazy-loading 'services' on Instance uuid 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:58:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-04c7d45e-71f0-4ed9-8518-ff3c89a255e0 req-569a0ad5-fcf5-4895-b915-b9d5a235250b service nova] Creating event network-changed:61e70911-2ed9-4794-ad68-81c843623a01 for instance 749cda36-ac85-44a0-836a-e7b9cea6f106 on user Nov 27 01:58:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-04c7d45e-71f0-4ed9-8518-ff3c89a255e0 req-569a0ad5-fcf5-4895-b915-b9d5a235250b service nova] Creating event network-vif-plugged:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:58:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-04c7d45e-71f0-4ed9-8518-ff3c89a255e0 req-569a0ad5-fcf5-4895-b915-b9d5a235250b service nova] Creating event network-vif-plugged:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 01:58:39 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-04c7d45e-71f0-4ed9-8518-ff3c89a255e0 req-569a0ad5-fcf5-4895-b915-b9d5a235250b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.033620 Nov 27 01:58:39 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 236/715] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-6508cb43-8e30-488c-8cc1-3b7ecb084521 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/os-volume_attachments/4ab5f227-9168-40b3-b11a-9b8bc5dabde7" status: 202 len: 0 microversion: 2.1 time: 0.335351 Nov 27 01:58:39 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 238/716] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:58:39 2023] DELETE /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/os-volume_attachments/4ab5f227-9168-40b3-b11a-9b8bc5dabde7 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 01:58:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:40 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2907e566-5395-4758-91ac-e8c377a11737 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.167135 Nov 27 01:58:41 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 243/717] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 01:58:40 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-interface => generated 283 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-ebfd4f93-f017-4c3d-bc0d-38c8432ee0e1 req-51d1896e-8510-4705-a2fc-63b7488cb837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}, {"server_uuid": "749cda36-ac85-44a0-836a-e7b9cea6f106", "name": "network-vif-plugged", "status": "completed", "tag": "61e70911-2ed9-4794-ad68-81c843623a01"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ebfd4f93-f017-4c3d-bc0d-38c8432ee0e1 req-51d1896e-8510-4705-a2fc-63b7488cb837 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ebfd4f93-f017-4c3d-bc0d-38c8432ee0e1 req-51d1896e-8510-4705-a2fc-63b7488cb837 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ebfd4f93-f017-4c3d-bc0d-38c8432ee0e1 req-51d1896e-8510-4705-a2fc-63b7488cb837 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-ebfd4f93-f017-4c3d-bc0d-38c8432ee0e1 req-51d1896e-8510-4705-a2fc-63b7488cb837 service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:58:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-ebfd4f93-f017-4c3d-bc0d-38c8432ee0e1 req-51d1896e-8510-4705-a2fc-63b7488cb837 service nova] Creating event network-vif-plugged:61e70911-2ed9-4794-ad68-81c843623a01 for instance 749cda36-ac85-44a0-836a-e7b9cea6f106 on user Nov 27 01:58:41 user devstack@n-api.service[65193]: DEBUG nova.compute.api [req-ebfd4f93-f017-4c3d-bc0d-38c8432ee0e1 req-51d1896e-8510-4705-a2fc-63b7488cb837 service nova] Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65193) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:58:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-ebfd4f93-f017-4c3d-bc0d-38c8432ee0e1 req-51d1896e-8510-4705-a2fc-63b7488cb837 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082431 Nov 27 01:58:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 237/718] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:42 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-9040127f-87aa-4141-ad93-4d16b7989361 req-a5d8c549-b6c8-4a44-a2a5-887d4614466e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9040127f-87aa-4141-ad93-4d16b7989361 req-a5d8c549-b6c8-4a44-a2a5-887d4614466e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9040127f-87aa-4141-ad93-4d16b7989361 req-a5d8c549-b6c8-4a44-a2a5-887d4614466e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9040127f-87aa-4141-ad93-4d16b7989361 req-a5d8c549-b6c8-4a44-a2a5-887d4614466e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-9040127f-87aa-4141-ad93-4d16b7989361 req-a5d8c549-b6c8-4a44-a2a5-887d4614466e service nova] Creating event network-changed:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:58:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-9040127f-87aa-4141-ad93-4d16b7989361 req-a5d8c549-b6c8-4a44-a2a5-887d4614466e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039625 Nov 27 01:58:42 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 239/719] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:42 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lazy-loading 'services' on Instance uuid 0e1143aa-dcb8-4970-b80a-0a9818e1b733 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 01:58:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-62aed5ec-44b7-40bc-bef1-ddb257427a78 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments/606828a7-ce62-441e-bef2-2b06b7c18321" status: 202 len: 0 microversion: 2.1 time: 0.183161 Nov 27 01:58:42 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 244/720] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 01:58:42 2023] DELETE /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments/606828a7-ce62-441e-bef2-2b06b7c18321 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7a78dd4f-b1e6-46b0-98eb-3c91abc6b68c tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056007 Nov 27 01:58:42 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 238/721] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:58:42 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-e195d4b5-1350-47ab-bf09-172ab0c437cb req-63d2192e-7b04-4d14-ba20-e631f2eff28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749cda36-ac85-44a0-836a-e7b9cea6f106", "name": "network-vif-plugged", "status": "completed", "tag": "61e70911-2ed9-4794-ad68-81c843623a01"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e195d4b5-1350-47ab-bf09-172ab0c437cb req-63d2192e-7b04-4d14-ba20-e631f2eff28c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e195d4b5-1350-47ab-bf09-172ab0c437cb req-63d2192e-7b04-4d14-ba20-e631f2eff28c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e195d4b5-1350-47ab-bf09-172ab0c437cb req-63d2192e-7b04-4d14-ba20-e631f2eff28c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-e195d4b5-1350-47ab-bf09-172ab0c437cb req-63d2192e-7b04-4d14-ba20-e631f2eff28c service nova] Creating event network-vif-plugged:61e70911-2ed9-4794-ad68-81c843623a01 for instance 749cda36-ac85-44a0-836a-e7b9cea6f106 on user Nov 27 01:58:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-e195d4b5-1350-47ab-bf09-172ab0c437cb req-63d2192e-7b04-4d14-ba20-e631f2eff28c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035802 Nov 27 01:58:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 240/722] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:44 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-80d0f994-d354-4a08-acf2-d1081c6c9734 req-46168a58-43d3-43df-84bc-7ac50b439a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-80d0f994-d354-4a08-acf2-d1081c6c9734 req-46168a58-43d3-43df-84bc-7ac50b439a99 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-80d0f994-d354-4a08-acf2-d1081c6c9734 req-46168a58-43d3-43df-84bc-7ac50b439a99 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-80d0f994-d354-4a08-acf2-d1081c6c9734 req-46168a58-43d3-43df-84bc-7ac50b439a99 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-80d0f994-d354-4a08-acf2-d1081c6c9734 req-46168a58-43d3-43df-84bc-7ac50b439a99 service nova] Creating event network-changed:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:58:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-80d0f994-d354-4a08-acf2-d1081c6c9734 req-46168a58-43d3-43df-84bc-7ac50b439a99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031620 Nov 27 01:58:44 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 245/723] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:53 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:53 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-cab89f4c-c5d8-4bb0-b63e-ba8c2e959502 req-74b2cbb5-b22f-400e-bcf8-befec4af4dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-cab89f4c-c5d8-4bb0-b63e-ba8c2e959502 req-74b2cbb5-b22f-400e-bcf8-befec4af4dab service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-cab89f4c-c5d8-4bb0-b63e-ba8c2e959502 req-74b2cbb5-b22f-400e-bcf8-befec4af4dab service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-cab89f4c-c5d8-4bb0-b63e-ba8c2e959502 req-74b2cbb5-b22f-400e-bcf8-befec4af4dab service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-cab89f4c-c5d8-4bb0-b63e-ba8c2e959502 req-74b2cbb5-b22f-400e-bcf8-befec4af4dab service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:58:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [req-cab89f4c-c5d8-4bb0-b63e-ba8c2e959502 req-74b2cbb5-b22f-400e-bcf8-befec4af4dab service nova] Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65193) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 27 01:58:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-cab89f4c-c5d8-4bb0-b63e-ba8c2e959502 req-74b2cbb5-b22f-400e-bcf8-befec4af4dab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053885 Nov 27 01:58:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 239/724] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:58:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=32 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:58:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-49e91e23-ece6-444d-8296-8303adebca92 req-0c0000ec-279d-40fc-927d-d6b19f5cc17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:58:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-49e91e23-ece6-444d-8296-8303adebca92 req-0c0000ec-279d-40fc-927d-d6b19f5cc17a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:58:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-49e91e23-ece6-444d-8296-8303adebca92 req-0c0000ec-279d-40fc-927d-d6b19f5cc17a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:58:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-49e91e23-ece6-444d-8296-8303adebca92 req-0c0000ec-279d-40fc-927d-d6b19f5cc17a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:58:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-49e91e23-ece6-444d-8296-8303adebca92 req-0c0000ec-279d-40fc-927d-d6b19f5cc17a service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 01:58:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-49e91e23-ece6-444d-8296-8303adebca92 req-0c0000ec-279d-40fc-927d-d6b19f5cc17a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036710 Nov 27 01:58:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 241/725] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:58:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2a996611-b76e-4edd-a682-ec23d5d065a4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2a996611-b76e-4edd-a682-ec23d5d065a4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2a996611-b76e-4edd-a682-ec23d5d065a4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2a996611-b76e-4edd-a682-ec23d5d065a4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:02 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-2a996611-b76e-4edd-a682-ec23d5d065a4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Going to try to stop instance {{(pid=65194) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 27 01:59:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2a996611-b76e-4edd-a682-ec23d5d065a4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/action" status: 202 len: 0 microversion: 2.1 time: 0.106458 Nov 27 01:59:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 246/726] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:59:02 2023] POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:02 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-05c28050-3d72-4085-b6a9-9e544010b743 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1662 microversion: 2.1 time: 0.317206 Nov 27 01:59:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 240/727] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:59:02 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1662 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:59:02 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6267eb5e-9433-4859-9d00-df342bc55b4f req-a46fe6e2-4bc5-4273-9b33-b9e3f134b2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-unplugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:59:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6267eb5e-9433-4859-9d00-df342bc55b4f req-a46fe6e2-4bc5-4273-9b33-b9e3f134b2a9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6267eb5e-9433-4859-9d00-df342bc55b4f req-a46fe6e2-4bc5-4273-9b33-b9e3f134b2a9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6267eb5e-9433-4859-9d00-df342bc55b4f req-a46fe6e2-4bc5-4273-9b33-b9e3f134b2a9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6267eb5e-9433-4859-9d00-df342bc55b4f req-a46fe6e2-4bc5-4273-9b33-b9e3f134b2a9 service nova] Creating event network-vif-unplugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:59:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6267eb5e-9433-4859-9d00-df342bc55b4f req-a46fe6e2-4bc5-4273-9b33-b9e3f134b2a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033575 Nov 27 01:59:02 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 242/728] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 01:59:04 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d0dfa6d5-4b66-460f-9553-234a69e9fa19 req-b5aadc76-1282-4863-90da-ecec41c70f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:59:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d0dfa6d5-4b66-460f-9553-234a69e9fa19 req-b5aadc76-1282-4863-90da-ecec41c70f24 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d0dfa6d5-4b66-460f-9553-234a69e9fa19 req-b5aadc76-1282-4863-90da-ecec41c70f24 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d0dfa6d5-4b66-460f-9553-234a69e9fa19 req-b5aadc76-1282-4863-90da-ecec41c70f24 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d0dfa6d5-4b66-460f-9553-234a69e9fa19 req-b5aadc76-1282-4863-90da-ecec41c70f24 service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 01:59:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d0dfa6d5-4b66-460f-9553-234a69e9fa19 req-b5aadc76-1282-4863-90da-ecec41c70f24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030830 Nov 27 01:59:04 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 247/729] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:08 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-19f6cfbf-273c-49de-a200-811033682e5c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c" status: 200 len: 1689 microversion: 2.87 time: 0.202139 Nov 27 01:59:08 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 241/730] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 01:59:08 2023] GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c => generated 1689 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:23 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5031f9bf-7722-4ff6-87bb-282873cba4d7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1745 microversion: 2.1 time: 0.417492 Nov 27 01:59:23 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 243/731] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:59:22 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1745 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:25 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2f23d086-5541-43f2-b02e-b20f52d126e4 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106" status: 200 len: 1542 microversion: 2.1 time: 0.212242 Nov 27 01:59:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 248/732] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:59:25 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106 => generated 1542 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=16 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=8 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:27 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:27 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d114929f-6970-4c99-9186-789810cb41f4 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1707 microversion: 2.1 time: 0.197651 Nov 27 01:59:27 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 242/733] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:59:27 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1707 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:59:32 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:32 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-155b37ca-f27f-452a-8473-62f70c1442f6 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041008 Nov 27 01:59:32 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 244/734] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 01:59:32 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:32 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 01:59:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8ac5fca8-7a5d-4953-a431-8e95d5056e52 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 204 len: 0 microversion: 2.1 time: 0.112667 Nov 27 01:59:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 249/735] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 01:59:32 2023] DELETE /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:59:32 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:32 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-758256c8-af2d-4e63-8d69-63eb7d4fe925 req-bbc7bc5c-2ac4-4370-a467-db93f9a91def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-unplugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:59:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-758256c8-af2d-4e63-8d69-63eb7d4fe925 req-bbc7bc5c-2ac4-4370-a467-db93f9a91def service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-758256c8-af2d-4e63-8d69-63eb7d4fe925 req-bbc7bc5c-2ac4-4370-a467-db93f9a91def service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-758256c8-af2d-4e63-8d69-63eb7d4fe925 req-bbc7bc5c-2ac4-4370-a467-db93f9a91def service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-758256c8-af2d-4e63-8d69-63eb7d4fe925 req-bbc7bc5c-2ac4-4370-a467-db93f9a91def service nova] Creating event network-vif-unplugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:59:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-758256c8-af2d-4e63-8d69-63eb7d4fe925 req-bbc7bc5c-2ac4-4370-a467-db93f9a91def service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032478 Nov 27 01:59:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 245/736] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:59:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:59:33 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-93a3eab1-4798-497f-9ad2-4e01ce7c5501 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 200 len: 1675 microversion: 2.1 time: 0.353475 Nov 27 01:59:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 243/737] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:59:32 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 1675 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:59:34 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-a4070d9f-45da-4118-a8d6-540add1dff5a req-cfe32625-3a0e-4e51-9867-749843890ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-deleted", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:59:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a4070d9f-45da-4118-a8d6-540add1dff5a req-cfe32625-3a0e-4e51-9867-749843890ddf service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a4070d9f-45da-4118-a8d6-540add1dff5a req-cfe32625-3a0e-4e51-9867-749843890ddf service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a4070d9f-45da-4118-a8d6-540add1dff5a req-cfe32625-3a0e-4e51-9867-749843890ddf service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-a4070d9f-45da-4118-a8d6-540add1dff5a req-cfe32625-3a0e-4e51-9867-749843890ddf service nova] Creating event network-vif-deleted:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:59:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-a4070d9f-45da-4118-a8d6-540add1dff5a req-cfe32625-3a0e-4e51-9867-749843890ddf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030228 Nov 27 01:59:34 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 250/738] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:59:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:59:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:59:34 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-559ae4d2-8a92-43f3-9ae2-74e88a05ebd6 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7/action" status: 204 len: 0 microversion: 2.1 time: 0.070616 Nov 27 01:59:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 246/739] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 01:59:34 2023] POST /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:34 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-85368c68-8bed-4ff2-a06a-ad2adf3d04b4 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1558 microversion: 2.1 time: 0.193537 Nov 27 01:59:34 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 244/740] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:59:34 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 01:59:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-a90f6874-a55e-4d60-819a-84835ba796a6 req-301a34c9-4fd2-4d7f-9496-d16be511f610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1143aa-dcb8-4970-b80a-0a9818e1b733", "name": "network-vif-plugged", "status": "completed", "tag": "a1ad1e6d-0c96-4147-9ec4-63d76c02b650"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 01:59:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a90f6874-a55e-4d60-819a-84835ba796a6 req-301a34c9-4fd2-4d7f-9496-d16be511f610 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a90f6874-a55e-4d60-819a-84835ba796a6 req-301a34c9-4fd2-4d7f-9496-d16be511f610 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a90f6874-a55e-4d60-819a-84835ba796a6 req-301a34c9-4fd2-4d7f-9496-d16be511f610 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-a90f6874-a55e-4d60-819a-84835ba796a6 req-301a34c9-4fd2-4d7f-9496-d16be511f610 service nova] Creating event network-vif-plugged:a1ad1e6d-0c96-4147-9ec4-63d76c02b650 for instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 on user Nov 27 01:59:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-a90f6874-a55e-4d60-819a-84835ba796a6 req-301a34c9-4fd2-4d7f-9496-d16be511f610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034605 Nov 27 01:59:35 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 251/741] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 01:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 01:59:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 01:59:53 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 01:59:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d9e092a9-6eba-4623-bdb9-bd3f987922b7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1639 microversion: 2.1 time: 0.238939 Nov 27 01:59:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 247/742] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 01:59:52 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1639 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:00:08 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:08 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=18 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-22303291"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:09 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-59fca30b-ce99-4b08-a6ec-5256774aaf6d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c/action" status: 202 len: 52 microversion: 2.87 time: 0.977063 Nov 27 02:00:09 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 245/743] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 02:00:08 2023] POST /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c/action => generated 52 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:15 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-caa3f047-281f-4c56-ac78-6d5c1b276a31 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c" status: 200 len: 1689 microversion: 2.87 time: 0.285872 Nov 27 02:00:15 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 252/744] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:00:15 2023] GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c => generated 1689 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 0e1143aa-dcb8-4970-b80a-0a9818e1b733] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1037957923"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] HTTP exception thrown: Instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 could not be found. Nov 27 02:00:23 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Returning 404 to user: Instance 0e1143aa-dcb8-4970-b80a-0a9818e1b733 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:00:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c7b855d5-fb7a-4b92-a808-627ac2858648 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733" status: 404 len: 111 microversion: 2.1 time: 0.266000 Nov 27 02:00:23 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 248/745] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:00:23 2023] GET /compute/v2.1/servers/0e1143aa-dcb8-4970-b80a-0a9818e1b733 => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:00:23 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3ac1c635-0fd1-4577-a288-3f98292ee8f8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '.version_select at 0x7f364b03f9a0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3ac1c635-0fd1-4577-a288-3f98292ee8f8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-825171087" status: 202 len: 0 microversion: 2.1 time: 0.025755 Nov 27 02:00:23 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 253/746] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 02:00:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-825171087 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:00:23 user devstack@n-api.service[65193]: INFO nova.network.security_group_api [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Removing security group aab46e17-f04c-400e-87d4-6ba2f5468f4a from port 6bc94eec-248b-4342-bfd1-5df305806d9c Nov 27 02:00:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-977a68ee-2b2a-40cb-bc94-212a8675c6c6 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/action" status: 202 len: 0 microversion: 2.1 time: 0.826190 Nov 27 02:00:24 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 246/747] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 02:00:23 2023] POST /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/action => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:00:24 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-5c6c0044-cdd3-4025-960d-b84e55fa6d7d req-6ebb6260-70e2-46cd-bbb7-86eb9c2f6bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5c6c0044-cdd3-4025-960d-b84e55fa6d7d req-6ebb6260-70e2-46cd-bbb7-86eb9c2f6bf5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5c6c0044-cdd3-4025-960d-b84e55fa6d7d req-6ebb6260-70e2-46cd-bbb7-86eb9c2f6bf5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5c6c0044-cdd3-4025-960d-b84e55fa6d7d req-6ebb6260-70e2-46cd-bbb7-86eb9c2f6bf5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-5c6c0044-cdd3-4025-960d-b84e55fa6d7d req-6ebb6260-70e2-46cd-bbb7-86eb9c2f6bf5 service nova] Creating event network-changed:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 02:00:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-5c6c0044-cdd3-4025-960d-b84e55fa6d7d req-6ebb6260-70e2-46cd-bbb7-86eb9c2f6bf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098192 Nov 27 02:00:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 249/748] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d3cf9a44-ab53-486e-9c8a-5cb399d3f3e5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1550 microversion: 2.1 time: 0.220335 Nov 27 02:00:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 254/749] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:00:25 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1550 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:00:25 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:25 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-506ccd86-58aa-49c9-9693-86ce792f5044 req-ea173ed7-ceb5-44f9-9782-65f7be63c567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-506ccd86-58aa-49c9-9693-86ce792f5044 req-ea173ed7-ceb5-44f9-9782-65f7be63c567 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-506ccd86-58aa-49c9-9693-86ce792f5044 req-ea173ed7-ceb5-44f9-9782-65f7be63c567 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-506ccd86-58aa-49c9-9693-86ce792f5044 req-ea173ed7-ceb5-44f9-9782-65f7be63c567 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-506ccd86-58aa-49c9-9693-86ce792f5044 req-ea173ed7-ceb5-44f9-9782-65f7be63c567 service nova] Creating event network-changed:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 02:00:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-506ccd86-58aa-49c9-9693-86ce792f5044 req-ea173ed7-ceb5-44f9-9782-65f7be63c567 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092433 Nov 27 02:00:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 255/750] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:25 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lazy-loading 'services' on Instance uuid 5da201ef-ad3c-4932-8423-ab43d9579efc {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:00:25 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3b6ac47a-1ca6-4ab6-94e5-818c5f9690fd tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments/2ff2984a-8180-430f-a66c-0b21b1688782" status: 202 len: 0 microversion: 2.1 time: 0.198591 Nov 27 02:00:25 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 250/751] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:00:25 2023] DELETE /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments/2ff2984a-8180-430f-a66c-0b21b1688782 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e4c6a1ae-5016-43f4-884d-c0a9c37275e0 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Nov 27 02:00:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 256/752] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:00:25 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:00:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9ac6d781-5e4d-4c5e-9488-f9371b4378db tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.568010 Nov 27 02:00:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 247/753] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:00:25 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-interface => generated 283 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-a63c54e3-c933-4089-a916-f616f06f835c req-724d31f7-d318-4b71-8285-69d539c120d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749cda36-ac85-44a0-836a-e7b9cea6f106", "tag": "61e70911-2ed9-4794-ad68-81c843623a01"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a63c54e3-c933-4089-a916-f616f06f835c req-724d31f7-d318-4b71-8285-69d539c120d0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a63c54e3-c933-4089-a916-f616f06f835c req-724d31f7-d318-4b71-8285-69d539c120d0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a63c54e3-c933-4089-a916-f616f06f835c req-724d31f7-d318-4b71-8285-69d539c120d0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-a63c54e3-c933-4089-a916-f616f06f835c req-724d31f7-d318-4b71-8285-69d539c120d0 service nova] Creating event network-changed:61e70911-2ed9-4794-ad68-81c843623a01 for instance 749cda36-ac85-44a0-836a-e7b9cea6f106 on user Nov 27 02:00:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-a63c54e3-c933-4089-a916-f616f06f835c req-724d31f7-d318-4b71-8285-69d539c120d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029613 Nov 27 02:00:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 251/754] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:26 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6397a7d5-d01f-408c-a42b-90bdb815e596 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/ips" status: 200 len: 108 microversion: 2.1 time: 0.046918 Nov 27 02:00:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 257/755] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:00:26 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/ips => generated 108 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:28 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-20438b3d-ef33-479a-8289-6a6039321ef8 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1707 microversion: 2.1 time: 0.254919 Nov 27 02:00:28 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 248/756] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:00:28 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1707 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:28 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-1f083c71-d547-49e4-a52b-39ef52bf7c63 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1707 microversion: 2.1 time: 0.300698 Nov 27 02:00:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 252/757] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:00:28 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1707 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:00:29 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f6d6156-8da1-4e8b-a1f4-1eace5b1a2a9"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:29 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:29 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0b0db64f-0a33-485b-8090-cc424280da39 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316047 Nov 27 02:00:29 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 258/758] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:00:29 2023] POST /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:00:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-fdc10b4c-afe8-418d-896c-d7467a470277 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6" status: 204 len: 0 microversion: 2.1 time: 0.124468 Nov 27 02:00:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 249/759] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:00:33 2023] DELETE /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:00:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:33 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:34 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-9c55f4ab-33c3-48ce-ae4a-3bd02e7dd5bb req-f677ab05-05a0-4b5e-8dff-f98178ccc8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-unplugged", "status": "completed", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9c55f4ab-33c3-48ce-ae4a-3bd02e7dd5bb req-f677ab05-05a0-4b5e-8dff-f98178ccc8e1 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9c55f4ab-33c3-48ce-ae4a-3bd02e7dd5bb req-f677ab05-05a0-4b5e-8dff-f98178ccc8e1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:34 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9c55f4ab-33c3-48ce-ae4a-3bd02e7dd5bb req-f677ab05-05a0-4b5e-8dff-f98178ccc8e1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-9c55f4ab-33c3-48ce-ae4a-3bd02e7dd5bb req-f677ab05-05a0-4b5e-8dff-f98178ccc8e1 service nova] Creating event network-vif-unplugged:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 02:00:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-9c55f4ab-33c3-48ce-ae4a-3bd02e7dd5bb req-f677ab05-05a0-4b5e-8dff-f98178ccc8e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109490 Nov 27 02:00:34 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 259/760] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:34 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-12f87a4d-1cdf-4a96-92a3-26c433c9f1c0 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6" status: 200 len: 1493 microversion: 2.1 time: 0.477782 Nov 27 02:00:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 253/761] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:00:33 2023] GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6 => generated 1493 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:00:36 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-eb15e1a7-0f11-4673-b723-5f32dec96323 req-188f78c4-276b-4237-8e1c-1a48bc9b960b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-plugged", "status": "completed", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}, {"server_uuid": "7b992061-61c3-471b-b36d-d7c9ec57ddf6", "name": "network-vif-deleted", "tag": "ebad5101-32cf-4530-99b1-18ca2852640f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-eb15e1a7-0f11-4673-b723-5f32dec96323 req-188f78c4-276b-4237-8e1c-1a48bc9b960b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-eb15e1a7-0f11-4673-b723-5f32dec96323 req-188f78c4-276b-4237-8e1c-1a48bc9b960b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:36 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-eb15e1a7-0f11-4673-b723-5f32dec96323 req-188f78c4-276b-4237-8e1c-1a48bc9b960b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-eb15e1a7-0f11-4673-b723-5f32dec96323 req-188f78c4-276b-4237-8e1c-1a48bc9b960b service nova] Creating event network-vif-plugged:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 02:00:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-eb15e1a7-0f11-4673-b723-5f32dec96323 req-188f78c4-276b-4237-8e1c-1a48bc9b960b service nova] Creating event network-vif-deleted:ebad5101-32cf-4530-99b1-18ca2852640f for instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 on user Nov 27 02:00:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-eb15e1a7-0f11-4673-b723-5f32dec96323 req-188f78c4-276b-4237-8e1c-1a48bc9b960b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031515 Nov 27 02:00:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 250/762] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-457e8b83-884d-418c-bdd2-828cb9ea0346 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: .version_select at 0x7f364b0a1e10>, body: {"keypair": {"name": "tempest-keypair-1164925591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbIb5moAVDQR5lAOMN230yeWn+B5VaaaY2j/peppZj8hy1kYS+mFJOau0RRKj7bYTCJnYKmuZooUAlPOALlAHV7henIEw6Fl5H3EkaKsWwhZ+x4qA+QP8j/BUwKq8T/+g=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:39 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-457e8b83-884d-418c-bdd2-828cb9ea0346 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for project 5da185c008a949dca58184441ccb0a41. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:00:39 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-457e8b83-884d-418c-bdd2-828cb9ea0346 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for user 82943dfd9046457e9f82f89cba00ff18 and project 5da185c008a949dca58184441ccb0a41. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:00:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-457e8b83-884d-418c-bdd2-828cb9ea0346 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048979 Nov 27 02:00:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 260/763] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:00:39 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1612375342", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e82e28e4-25ab-4f21-9e45-49763803697d"}], "security_groups": [{"name": "tempest-securitygroup--1396066832"}], "key_name": "tempest-keypair-1164925591", "user_data": "}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:40 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] validate_networks() for [('e82e28e4-25ab-4f21-9e45-49763803697d', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for project 5da185c008a949dca58184441ccb0a41. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for user 82943dfd9046457e9f82f89cba00ff18 and project 5da185c008a949dca58184441ccb0a41. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:00:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:00:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-6f13be29-b7b5-445c-8276-5273ebf56137 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.601968 Nov 27 02:00:41 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 254/764] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:00:40 2023] POST /compute/v2.1/servers => generated 400 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:00:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d429b173-f685-48da-9eac-e86c2bcdbc07 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:41 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d429b173-f685-48da-9eac-e86c2bcdbc07 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:41 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-d429b173-f685-48da-9eac-e86c2bcdbc07 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d429b173-f685-48da-9eac-e86c2bcdbc07 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb" status: 200 len: 1234 microversion: 2.1 time: 0.068974 Nov 27 02:00:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 251/765] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:00:41 2023] GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb => generated 1234 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:00:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d0ff0dc7-730a-49b3-8bf6-186cab77e235 req-702a2e06-095f-410e-ba13-d64b22d20396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa0beed-c279-460c-8dec-9cf2481a8dfb", "tag": "df3bd047-ed97-406d-80b8-09396731e8b9"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d0ff0dc7-730a-49b3-8bf6-186cab77e235 req-702a2e06-095f-410e-ba13-d64b22d20396 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d0ff0dc7-730a-49b3-8bf6-186cab77e235 req-702a2e06-095f-410e-ba13-d64b22d20396 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d0ff0dc7-730a-49b3-8bf6-186cab77e235 req-702a2e06-095f-410e-ba13-d64b22d20396 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d0ff0dc7-730a-49b3-8bf6-186cab77e235 req-702a2e06-095f-410e-ba13-d64b22d20396 service nova] Creating event network-changed:df3bd047-ed97-406d-80b8-09396731e8b9 for instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb on user Nov 27 02:00:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d0ff0dc7-730a-49b3-8bf6-186cab77e235 req-702a2e06-095f-410e-ba13-d64b22d20396 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038258 Nov 27 02:00:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 261/766] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:45 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-6f18ea2a-1876-492b-b63f-99ac6bce1aa6 req-44531128-2030-442a-b855-d4b7f3b6b897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa0beed-c279-460c-8dec-9cf2481a8dfb", "name": "network-vif-plugged", "status": "completed", "tag": "df3bd047-ed97-406d-80b8-09396731e8b9"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f18ea2a-1876-492b-b63f-99ac6bce1aa6 req-44531128-2030-442a-b855-d4b7f3b6b897 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f18ea2a-1876-492b-b63f-99ac6bce1aa6 req-44531128-2030-442a-b855-d4b7f3b6b897 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-6f18ea2a-1876-492b-b63f-99ac6bce1aa6 req-44531128-2030-442a-b855-d4b7f3b6b897 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:45 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-6f18ea2a-1876-492b-b63f-99ac6bce1aa6 req-44531128-2030-442a-b855-d4b7f3b6b897 service nova] Creating event network-vif-plugged:df3bd047-ed97-406d-80b8-09396731e8b9 for instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb on user Nov 27 02:00:45 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-6f18ea2a-1876-492b-b63f-99ac6bce1aa6 req-44531128-2030-442a-b855-d4b7f3b6b897 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042834 Nov 27 02:00:45 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 255/767] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:47 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-e7cbf7a1-6d5c-4ce9-b690-fdb58a8fdf98 req-997c58de-6ce1-4170-bd9e-32d363c6d4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa0beed-c279-460c-8dec-9cf2481a8dfb", "name": "network-vif-plugged", "status": "completed", "tag": "df3bd047-ed97-406d-80b8-09396731e8b9"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:47 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e7cbf7a1-6d5c-4ce9-b690-fdb58a8fdf98 req-997c58de-6ce1-4170-bd9e-32d363c6d4a9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e7cbf7a1-6d5c-4ce9-b690-fdb58a8fdf98 req-997c58de-6ce1-4170-bd9e-32d363c6d4a9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e7cbf7a1-6d5c-4ce9-b690-fdb58a8fdf98 req-997c58de-6ce1-4170-bd9e-32d363c6d4a9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:47 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e7cbf7a1-6d5c-4ce9-b690-fdb58a8fdf98 req-997c58de-6ce1-4170-bd9e-32d363c6d4a9 service nova] Creating event network-vif-plugged:df3bd047-ed97-406d-80b8-09396731e8b9 for instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb on user Nov 27 02:00:47 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-e7cbf7a1-6d5c-4ce9-b690-fdb58a8fdf98 req-997c58de-6ce1-4170-bd9e-32d363c6d4a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031109 Nov 27 02:00:47 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 252/768] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:53 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e84fe867-8ea7-479d-b9b4-e71dfa778171 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e84fe867-8ea7-479d-b9b4-e71dfa778171 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e84fe867-8ea7-479d-b9b4-e71dfa778171 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e84fe867-8ea7-479d-b9b4-e71dfa778171 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:53 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-e84fe867-8ea7-479d-b9b4-e71dfa778171 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Going to try to start instance {{(pid=65194) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 27 02:00:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e84fe867-8ea7-479d-b9b4-e71dfa778171 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/action" status: 202 len: 0 microversion: 2.1 time: 0.071747 Nov 27 02:00:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 262/769] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 02:00:53 2023] POST /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:53 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:00:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5f076c46-f986-408f-a1bf-a527c38e0107 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1648 microversion: 2.1 time: 0.278560 Nov 27 02:00:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 256/770] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:00:53 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1648 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:00:56 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:00:56 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-beecdefe-4966-47c1-ae5f-5e4eba54021c req-3dc42dbc-1f00-4416-91db-ba85fb7e2a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-beecdefe-4966-47c1-ae5f-5e4eba54021c req-3dc42dbc-1f00-4416-91db-ba85fb7e2a58 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-beecdefe-4966-47c1-ae5f-5e4eba54021c req-3dc42dbc-1f00-4416-91db-ba85fb7e2a58 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-beecdefe-4966-47c1-ae5f-5e4eba54021c req-3dc42dbc-1f00-4416-91db-ba85fb7e2a58 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-beecdefe-4966-47c1-ae5f-5e4eba54021c req-3dc42dbc-1f00-4416-91db-ba85fb7e2a58 service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 02:00:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-beecdefe-4966-47c1-ae5f-5e4eba54021c req-3dc42dbc-1f00-4416-91db-ba85fb7e2a58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034477 Nov 27 02:00:56 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 253/771] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:00:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-220e77e1-dae3-4554-8f38-b4752d6f8505 req-7934074e-38bd-470b-bdfc-cdd948ee7ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:00:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-220e77e1-dae3-4554-8f38-b4752d6f8505 req-7934074e-38bd-470b-bdfc-cdd948ee7ea6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:00:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-220e77e1-dae3-4554-8f38-b4752d6f8505 req-7934074e-38bd-470b-bdfc-cdd948ee7ea6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:00:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-220e77e1-dae3-4554-8f38-b4752d6f8505 req-7934074e-38bd-470b-bdfc-cdd948ee7ea6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:00:58 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-220e77e1-dae3-4554-8f38-b4752d6f8505 req-7934074e-38bd-470b-bdfc-cdd948ee7ea6 service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 02:00:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-220e77e1-dae3-4554-8f38-b4752d6f8505 req-7934074e-38bd-470b-bdfc-cdd948ee7ea6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032901 Nov 27 02:00:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 263/772] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:00:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-985085354", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "90ee5c23-b10e-4785-b18a-9db7939564b3", "destination_type": "volume"}], "networks": [{"uuid": "0674729f-c03e-4bfb-bfbe-32ac4c167bcf"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:15 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:15 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:15 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] validate_networks() for [('0674729f-c03e-4bfb-bfbe-32ac4c167bcf', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-fa03edbf-f209-4bb0-bf02-e7ae19b8ee3e tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047422 Nov 27 02:01:15 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 254/773] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:01:15 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] HTTP exception thrown: Instance 5da201ef-ad3c-4932-8423-ab43d9579efc is not attached to volume 2ff2984a-8180-430f-a66c-0b21b1688782 Nov 27 02:01:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Returning 404 to user: Instance 5da201ef-ad3c-4932-8423-ab43d9579efc is not attached to volume 2ff2984a-8180-430f-a66c-0b21b1688782 {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:01:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0445df3f-7fff-4b02-bcb8-4117a4f13eb7 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments/2ff2984a-8180-430f-a66c-0b21b1688782" status: 404 len: 154 microversion: 2.1 time: 0.148195 Nov 27 02:01:15 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 264/774] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:01:15 2023] DELETE /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc/os-volume_attachments/2ff2984a-8180-430f-a66c-0b21b1688782 => generated 154 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Getting quotas for project b168d75a030e425886b18204a7173843. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Getting quotas for user 357d7d579c284bcd836dd8075476d5ed and project b168d75a030e425886b18204a7173843. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:01:16 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:01:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-afb4acca-2224-4a30-abfc-2a7f70fefccf tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.628581 Nov 27 02:01:16 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 257/775] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Nov 27 02:01:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 27 02:01:16 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4332a6ff-d0d1-4137-910e-ef2e99830d28 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:16 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4332a6ff-d0d1-4137-910e-ef2e99830d28 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:16 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4332a6ff-d0d1-4137-910e-ef2e99830d28 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:16 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4332a6ff-d0d1-4137-910e-ef2e99830d28 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:16 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-4332a6ff-d0d1-4137-910e-ef2e99830d28 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:16 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4332a6ff-d0d1-4137-910e-ef2e99830d28 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 200 len: 1394 microversion: 2.87 time: 0.082852 Nov 27 02:01:16 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 255/776] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:01:16 2023] GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 1394 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:01:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-146fd069-0e44-4202-ae50-d0fdb46c7d93 req-ced7383c-2d43-4951-bd05-67cd9e6f4950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-146fd069-0e44-4202-ae50-d0fdb46c7d93 req-ced7383c-2d43-4951-bd05-67cd9e6f4950 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-146fd069-0e44-4202-ae50-d0fdb46c7d93 req-ced7383c-2d43-4951-bd05-67cd9e6f4950 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-146fd069-0e44-4202-ae50-d0fdb46c7d93 req-ced7383c-2d43-4951-bd05-67cd9e6f4950 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-146fd069-0e44-4202-ae50-d0fdb46c7d93 req-ced7383c-2d43-4951-bd05-67cd9e6f4950 service nova] Creating event network-changed:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:01:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-146fd069-0e44-4202-ae50-d0fdb46c7d93 req-ced7383c-2d43-4951-bd05-67cd9e6f4950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035331 Nov 27 02:01:18 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 265/777] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:19 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:01:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-86267d74-8e8f-4190-8015-a2bf9ff55113 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 204 len: 0 microversion: 2.1 time: 0.136200 Nov 27 02:01:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 258/778] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:01:19 2023] DELETE /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:19 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10716a7e05b54eef981b7c20e6b796ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e2e5ce3c4145fb92668e1a767d9881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6908b075-259b-4e4c-81b5-b55156c668c9 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 200 len: 1540 microversion: 2.1 time: 0.265030 Nov 27 02:01:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 256/779] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:01:19 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 1540 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:01:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-73351570-a643-4328-a237-825523b95258 req-1a01461f-b4c6-406e-aa24-3bfd26300558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-unplugged", "status": "completed", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}, {"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-plugged", "status": "completed", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73351570-a643-4328-a237-825523b95258 req-1a01461f-b4c6-406e-aa24-3bfd26300558 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73351570-a643-4328-a237-825523b95258 req-1a01461f-b4c6-406e-aa24-3bfd26300558 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-73351570-a643-4328-a237-825523b95258 req-1a01461f-b4c6-406e-aa24-3bfd26300558 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-73351570-a643-4328-a237-825523b95258 req-1a01461f-b4c6-406e-aa24-3bfd26300558 service nova] Creating event network-vif-unplugged:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 02:01:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-73351570-a643-4328-a237-825523b95258 req-1a01461f-b4c6-406e-aa24-3bfd26300558 service nova] Creating event network-vif-plugged:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 02:01:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-73351570-a643-4328-a237-825523b95258 req-1a01461f-b4c6-406e-aa24-3bfd26300558 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.063029 Nov 27 02:01:20 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 266/780] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-815a058c-02d5-4b94-9aa1-2bc5e8768488 req-4148f3dd-04b6-4c57-8e5b-01fe986a5d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da201ef-ad3c-4932-8423-ab43d9579efc", "name": "network-vif-deleted", "tag": "6bc94eec-248b-4342-bfd1-5df305806d9c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-815a058c-02d5-4b94-9aa1-2bc5e8768488 req-4148f3dd-04b6-4c57-8e5b-01fe986a5d94 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-815a058c-02d5-4b94-9aa1-2bc5e8768488 req-4148f3dd-04b6-4c57-8e5b-01fe986a5d94 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-815a058c-02d5-4b94-9aa1-2bc5e8768488 req-4148f3dd-04b6-4c57-8e5b-01fe986a5d94 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-815a058c-02d5-4b94-9aa1-2bc5e8768488 req-4148f3dd-04b6-4c57-8e5b-01fe986a5d94 service nova] Creating event network-vif-deleted:6bc94eec-248b-4342-bfd1-5df305806d9c for instance 5da201ef-ad3c-4932-8423-ab43d9579efc on user Nov 27 02:01:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-815a058c-02d5-4b94-9aa1-2bc5e8768488 req-4148f3dd-04b6-4c57-8e5b-01fe986a5d94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031662 Nov 27 02:01:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 259/781] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: 7b992061-61c3-471b-b36d-d7c9ec57ddf6] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] HTTP exception thrown: Instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 could not be found. Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Returning 404 to user: Instance 7b992061-61c3-471b-b36d-d7c9ec57ddf6 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:01:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7528ad45-8650-4ed8-9f6c-c4a0a6e0a36f tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6" status: 404 len: 111 microversion: 2.1 time: 0.026819 Nov 27 02:01:24 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 257/782] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:01:24 2023] GET /compute/v2.1/servers/7b992061-61c3-471b-b36d-d7c9ec57ddf6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:24 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:01:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4b277881-2b96-4ab2-a680-9660d2287ea1 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 204 len: 0 microversion: 2.1 time: 0.131905 Nov 27 02:01:24 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 267/783] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:01:24 2023] DELETE /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:24 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44beb0a742a24c30a7e2004988809c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a953169393c9425985ef738e51b22868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9ed90a86-f79d-4d67-891f-0d309c22bdbf tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 200 len: 1507 microversion: 2.1 time: 0.314186 Nov 27 02:01:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 260/784] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:01:24 2023] GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-6bcb252b-8c4a-4098-ba67-d74d8b91a224 req-a5ce7a48-9c5c-402e-b95b-579dbc218fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-unplugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6bcb252b-8c4a-4098-ba67-d74d8b91a224 req-a5ce7a48-9c5c-402e-b95b-579dbc218fcd service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6bcb252b-8c4a-4098-ba67-d74d8b91a224 req-a5ce7a48-9c5c-402e-b95b-579dbc218fcd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6bcb252b-8c4a-4098-ba67-d74d8b91a224 req-a5ce7a48-9c5c-402e-b95b-579dbc218fcd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-6bcb252b-8c4a-4098-ba67-d74d8b91a224 req-a5ce7a48-9c5c-402e-b95b-579dbc218fcd service nova] Creating event network-vif-unplugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 02:01:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-6bcb252b-8c4a-4098-ba67-d74d8b91a224 req-a5ce7a48-9c5c-402e-b95b-579dbc218fcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033150 Nov 27 02:01:24 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 258/785] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:25 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-922e02cd-401e-46e1-b901-1527a25df102 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1550 microversion: 2.1 time: 0.327850 Nov 27 02:01:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 268/786] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:01:25 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1550 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:01:25 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:25 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:25 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:25 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-c6f878b6-0852-45c1-a101-e3c0d5cc3ef0 req-b65b5245-39a8-418e-ba60-3962878a214f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-deleted", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c6f878b6-0852-45c1-a101-e3c0d5cc3ef0 req-b65b5245-39a8-418e-ba60-3962878a214f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c6f878b6-0852-45c1-a101-e3c0d5cc3ef0 req-b65b5245-39a8-418e-ba60-3962878a214f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c6f878b6-0852-45c1-a101-e3c0d5cc3ef0 req-b65b5245-39a8-418e-ba60-3962878a214f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-c6f878b6-0852-45c1-a101-e3c0d5cc3ef0 req-b65b5245-39a8-418e-ba60-3962878a214f service nova] Creating event network-vif-deleted:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 02:01:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-c6f878b6-0852-45c1-a101-e3c0d5cc3ef0 req-b65b5245-39a8-418e-ba60-3962878a214f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029497 Nov 27 02:01:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 259/787] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:25 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-0864481c-cc48-4106-91dd-1da14d3e4e5b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7/action" status: 200 len: 32159 microversion: 2.1 time: 0.264009 Nov 27 02:01:25 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 261/788] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 02:01:25 2023] POST /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7/action => generated 32159 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:26 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-46f1d4af-26a5-4538-924b-d8204a049f16 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1542 microversion: 2.1 time: 0.161191 Nov 27 02:01:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 269/789] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:01:26 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1542 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:01:26 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-b1b9c6b7-4a99-4e4c-88e6-828f1407d66f req-4f91b925-5cec-405e-ad36-20c7ae5d37f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd137692-54b9-481d-b758-b9f1a5e67b82", "name": "network-vif-plugged", "status": "completed", "tag": "3421787b-2ad5-465e-b088-dd180cf5f150"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b1b9c6b7-4a99-4e4c-88e6-828f1407d66f req-4f91b925-5cec-405e-ad36-20c7ae5d37f9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b1b9c6b7-4a99-4e4c-88e6-828f1407d66f req-4f91b925-5cec-405e-ad36-20c7ae5d37f9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b1b9c6b7-4a99-4e4c-88e6-828f1407d66f req-4f91b925-5cec-405e-ad36-20c7ae5d37f9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b1b9c6b7-4a99-4e4c-88e6-828f1407d66f req-4f91b925-5cec-405e-ad36-20c7ae5d37f9 service nova] Creating event network-vif-plugged:3421787b-2ad5-465e-b088-dd180cf5f150 for instance cd137692-54b9-481d-b758-b9f1a5e67b82 on user Nov 27 02:01:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-b1b9c6b7-4a99-4e4c-88e6-828f1407d66f req-4f91b925-5cec-405e-ad36-20c7ae5d37f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057726 Nov 27 02:01:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 260/790] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:28 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:01:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-0d9ce84a-ed0e-462d-a3e1-5fa35d273ff9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 204 len: 0 microversion: 2.1 time: 0.125111 Nov 27 02:01:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 262/791] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:01:28 2023] DELETE /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:01:28 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:28 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:29 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4303689d56b490b9a71fc41cb1346bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a5273d2eb24e2598a4e7d6dc2a4d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:29 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6f8b8c5c-fac6-438a-9b0a-8a5267253f5a tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 200 len: 1713 microversion: 2.1 time: 0.253360 Nov 27 02:01:29 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 270/792] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:01:28 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 1713 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:01:29 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-14ca8d8f-f246-4db0-8329-daebd064ea2a req-9b7991b1-63cc-4f64-be42-6748e8a258f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-unplugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-14ca8d8f-f246-4db0-8329-daebd064ea2a req-9b7991b1-63cc-4f64-be42-6748e8a258f6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-14ca8d8f-f246-4db0-8329-daebd064ea2a req-9b7991b1-63cc-4f64-be42-6748e8a258f6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:29 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-14ca8d8f-f246-4db0-8329-daebd064ea2a req-9b7991b1-63cc-4f64-be42-6748e8a258f6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-14ca8d8f-f246-4db0-8329-daebd064ea2a req-9b7991b1-63cc-4f64-be42-6748e8a258f6 service nova] Creating event network-vif-unplugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 02:01:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-14ca8d8f-f246-4db0-8329-daebd064ea2a req-9b7991b1-63cc-4f64-be42-6748e8a258f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029825 Nov 27 02:01:29 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 261/793] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-72f2d97d-fd53-4f92-87de-d312da92d184 req-39fa71d1-2b90-483d-8fda-be9c5cf4fa16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-deleted", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-72f2d97d-fd53-4f92-87de-d312da92d184 req-39fa71d1-2b90-483d-8fda-be9c5cf4fa16 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-72f2d97d-fd53-4f92-87de-d312da92d184 req-39fa71d1-2b90-483d-8fda-be9c5cf4fa16 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-72f2d97d-fd53-4f92-87de-d312da92d184 req-39fa71d1-2b90-483d-8fda-be9c5cf4fa16 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-72f2d97d-fd53-4f92-87de-d312da92d184 req-39fa71d1-2b90-483d-8fda-be9c5cf4fa16 service nova] Creating event network-vif-deleted:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 02:01:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-72f2d97d-fd53-4f92-87de-d312da92d184 req-39fa71d1-2b90-483d-8fda-be9c5cf4fa16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032212 Nov 27 02:01:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 263/794] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-ed7c4faa-1598-4bbc-8688-9c2e0c5e9583 req-744b3cb0-e007-4471-8012-5454c70008ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60b0fb9-9f88-4d6d-a507-8f2befd725c8", "name": "network-vif-plugged", "status": "completed", "tag": "bf6a3b4d-0156-4251-a887-54f788ba3f7b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ed7c4faa-1598-4bbc-8688-9c2e0c5e9583 req-744b3cb0-e007-4471-8012-5454c70008ff service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ed7c4faa-1598-4bbc-8688-9c2e0c5e9583 req-744b3cb0-e007-4471-8012-5454c70008ff service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ed7c4faa-1598-4bbc-8688-9c2e0c5e9583 req-744b3cb0-e007-4471-8012-5454c70008ff service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ed7c4faa-1598-4bbc-8688-9c2e0c5e9583 req-744b3cb0-e007-4471-8012-5454c70008ff service nova] Creating event network-vif-plugged:bf6a3b4d-0156-4251-a887-54f788ba3f7b for instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 on user Nov 27 02:01:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-ed7c4faa-1598-4bbc-8688-9c2e0c5e9583 req-744b3cb0-e007-4471-8012-5454c70008ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030464 Nov 27 02:01:31 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 271/795] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:31 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a5f27d4c-d5e9-4b3c-8943-1a8d789bdfe0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb" status: 200 len: 1543 microversion: 2.1 time: 0.204330 Nov 27 02:01:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 262/796] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:01:31 2023] GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb => generated 1543 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:01:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-f2802998-3cd9-497f-a036-1775ee9aa971 req-c96c5a7c-dcfe-40a5-a730-b80557c90df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f2802998-3cd9-497f-a036-1775ee9aa971 req-c96c5a7c-dcfe-40a5-a730-b80557c90df9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f2802998-3cd9-497f-a036-1775ee9aa971 req-c96c5a7c-dcfe-40a5-a730-b80557c90df9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f2802998-3cd9-497f-a036-1775ee9aa971 req-c96c5a7c-dcfe-40a5-a730-b80557c90df9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-f2802998-3cd9-497f-a036-1775ee9aa971 req-c96c5a7c-dcfe-40a5-a730-b80557c90df9 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:01:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-f2802998-3cd9-497f-a036-1775ee9aa971 req-c96c5a7c-dcfe-40a5-a730-b80557c90df9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036911 Nov 27 02:01:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 264/797] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-117017b0-eeb9-4a3d-b8a6-85ea93cae03c req-0807ba04-82f0-41c8-b8f3-8584da20e769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:01:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-117017b0-eeb9-4a3d-b8a6-85ea93cae03c req-0807ba04-82f0-41c8-b8f3-8584da20e769 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-117017b0-eeb9-4a3d-b8a6-85ea93cae03c req-0807ba04-82f0-41c8-b8f3-8584da20e769 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-117017b0-eeb9-4a3d-b8a6-85ea93cae03c req-0807ba04-82f0-41c8-b8f3-8584da20e769 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-117017b0-eeb9-4a3d-b8a6-85ea93cae03c req-0807ba04-82f0-41c8-b8f3-8584da20e769 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:01:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-117017b0-eeb9-4a3d-b8a6-85ea93cae03c req-0807ba04-82f0-41c8-b8f3-8584da20e769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029018 Nov 27 02:01:35 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 272/798] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:01:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=22 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=28 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:01:43 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:01:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9cdfa7c4-b154-47f5-ba90-7a4d36b45c49 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1652 microversion: 2.1 time: 0.202359 Nov 27 02:01:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 263/799] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:01:43 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1652 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:02:06 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:02:06 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-f70043b3-2755-4215-b980-07e5bfda8a90 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 200 len: 1767 microversion: 2.87 time: 0.265516 Nov 27 02:02:06 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 265/800] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:02:06 2023] GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 1767 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] [instance: 5da201ef-ad3c-4932-8423-ab43d9579efc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] HTTP exception thrown: Instance 5da201ef-ad3c-4932-8423-ab43d9579efc could not be found. Nov 27 02:02:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Returning 404 to user: Instance 5da201ef-ad3c-4932-8423-ab43d9579efc could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-685a0651-909d-4806-9bbe-d5e09c2c08ef tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc" status: 404 len: 111 microversion: 2.1 time: 0.038945 Nov 27 02:02:09 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 273/801] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:02:09 2023] GET /compute/v2.1/servers/5da201ef-ad3c-4932-8423-ab43d9579efc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:09 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:09 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ae0c3e6d-102b-4c6b-aa1b-a338685a3136 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] Calling method '.version_select at 0x7f364b2c1870>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ae0c3e6d-102b-4c6b-aa1b-a338685a3136 tempest-TestMinimumBasicScenario-570450055 tempest-TestMinimumBasicScenario-570450055-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1854039273" status: 202 len: 0 microversion: 2.1 time: 0.028760 Nov 27 02:02:09 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 264/802] 10.0.0.210 () {62 vars in 1349 bytes} [Mon Nov 27 02:02:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1854039273 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] [instance: cd137692-54b9-481d-b758-b9f1a5e67b82] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:14 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] HTTP exception thrown: Instance cd137692-54b9-481d-b758-b9f1a5e67b82 could not be found. Nov 27 02:02:14 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] Returning 404 to user: Instance cd137692-54b9-481d-b758-b9f1a5e67b82 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:14 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c8653d16-6b37-43f4-a80b-1c4a6838b6c8 tempest-ServerRescueNegativeTestJSON-760184345 tempest-ServerRescueNegativeTestJSON-760184345-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82" status: 404 len: 111 microversion: 2.1 time: 0.028039 Nov 27 02:02:14 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 266/803] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:02:14 2023] GET /compute/v2.1/servers/cd137692-54b9-481d-b758-b9f1a5e67b82 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-91403f09-ae94-405d-a92b-741a32e74d91 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Action: 'create', calling method: .version_select at 0x7f364b0a2c20>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-589904682"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] HTTP exception thrown: Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 could not be found. Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Returning 404 to user: Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-024c5ef2-cdd5-49df-947e-cac638e7f0c9 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 404 len: 111 microversion: 2.1 time: 0.038357 Nov 27 02:02:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 265/804] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:02:19 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-91403f09-ae94-405d-a92b-741a32e74d91 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.534817 Nov 27 02:02:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 274/805] 10.0.0.210 () {64 vars in 1232 bytes} [Mon Nov 27 02:02:18 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 536 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6c46805a-614d-4732-a7a8-5ac43892b92b tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b3908b0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] HTTP exception thrown: Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 could not be found. Nov 27 02:02:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Returning 404 to user: Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9c4e119f-c647-4be5-b67d-b22d43991f66 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030972 Nov 27 02:02:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 267/806] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:02:19 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6c46805a-614d-4732-a7a8-5ac43892b92b tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 200 len: 344 microversion: 2.1 time: 0.057937 Nov 27 02:02:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 266/807] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:02:19 2023] GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:20 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:20 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-eba9d61f-dc63-449f-aa89-900f13b875cb tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364c13bbe0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-eba9d61f-dc63-449f-aa89-900f13b875cb tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 200 len: 344 microversion: 2.1 time: 0.160380 Nov 27 02:02:20 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 275/808] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:02:20 2023] GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 344 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ab67e133-df69-4612-bef5-893f3482ec0a tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364afccd30>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ab67e133-df69-4612-bef5-893f3482ec0a tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 200 len: 345 microversion: 2.1 time: 0.057904 Nov 27 02:02:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 268/809] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:02:21 2023] GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-76fa33ed-8842-4076-b96e-7b7cc93f754c tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Action: 'create', calling method: .version_select at 0x7f364b3f1090>, body: {"snapshot": {"volume_id": "7c3c5fe4-9d37-472e-8c87-5c0173cee41a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1152749174"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:21 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-76fa33ed-8842-4076-b96e-7b7cc93f754c tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.200196 Nov 27 02:02:21 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 267/810] 10.0.0.210 () {64 vars in 1239 bytes} [Mon Nov 27 02:02:21 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4522f79c-fe41-49b8-91a8-e216abf1ddb3 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b0a3520>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4522f79c-fe41-49b8-91a8-e216abf1ddb3 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 200 len: 287 microversion: 2.1 time: 0.042682 Nov 27 02:02:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 276/811] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:21 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d49dbf4e-353f-4d97-ac97-1cde3cb94b88 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364afcdfc0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d49dbf4e-353f-4d97-ac97-1cde3cb94b88 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.065051 Nov 27 02:02:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 269/812] 10.0.0.210 () {62 vars in 1217 bytes} [Mon Nov 27 02:02:21 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-5ea9878d-3a83-4a37-8330-fdbf4ca15f27 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b69d510>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:21 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-5ea9878d-3a83-4a37-8330-fdbf4ca15f27 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 200 len: 287 microversion: 2.1 time: 0.054621 Nov 27 02:02:21 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 268/813] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:21 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] HTTP exception thrown: Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 could not be found. Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Returning 404 to user: Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b8b9f52a-a6cd-4f5b-8893-60be939a2987 tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 404 len: 111 microversion: 2.1 time: 0.029496 Nov 27 02:02:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 277/814] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:02:22 2023] DELETE /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] [instance: c60b0fb9-9f88-4d6d-a507-8f2befd725c8] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] HTTP exception thrown: Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 could not be found. Nov 27 02:02:22 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Returning 404 to user: Instance c60b0fb9-9f88-4d6d-a507-8f2befd725c8 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-09c56d0a-5d58-40b4-98a6-1aa555ab74cc tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8" status: 404 len: 111 microversion: 2.1 time: 0.034944 Nov 27 02:02:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 270/815] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:02:22 2023] GET /compute/v2.1/servers/c60b0fb9-9f88-4d6d-a507-8f2befd725c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:22 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9eefd17e-cbb2-4e8a-8f0c-d1a5429ba9dd tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] Calling method '.version_select at 0x7f364b7ca4d0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9eefd17e-cbb2-4e8a-8f0c-d1a5429ba9dd tempest-ServerActionsTestOtherB-534354791 tempest-ServerActionsTestOtherB-534354791-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052011216" status: 202 len: 0 microversion: 2.1 time: 0.026582 Nov 27 02:02:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 269/816] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 02:02:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052011216 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:02:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5e1abcfd-3856-4d48-bc3f-bf764ad5c651 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b03f400>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5e1abcfd-3856-4d48-bc3f-bf764ad5c651 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 200 len: 287 microversion: 2.1 time: 0.082821 Nov 27 02:02:23 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 278/817] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:22 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:24 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8ea64014-ef71-4bb0-a0fb-917b427a4fec tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364afcd630>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-8ea64014-ef71-4bb0-a0fb-917b427a4fec tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 200 len: 287 microversion: 2.1 time: 0.059595 Nov 27 02:02:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 271/818] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:24 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:02:25 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6a469604-8b54-411a-a5b7-bc2b2fc7f9ba tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b4bc4c0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6a469604-8b54-411a-a5b7-bc2b2fc7f9ba tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 200 len: 288 microversion: 2.1 time: 0.037538 Nov 27 02:02:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 270/819] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:25 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-9a601a35-15fe-4dd3-912c-76d660622a91 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364af291b0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-9a601a35-15fe-4dd3-912c-76d660622a91 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 202 len: 0 microversion: 2.1 time: 0.073647 Nov 27 02:02:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 279/820] 10.0.0.210 () {62 vars in 1331 bytes} [Mon Nov 27 02:02:25 2023] DELETE /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 02:02:25 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-13d4dfc4-a602-4e60-abb4-3bc95e135648 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364ae59fc0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:25 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-13d4dfc4-a602-4e60-abb4-3bc95e135648 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 200 len: 287 microversion: 2.1 time: 0.037147 Nov 27 02:02:25 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 272/821] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:25 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-b17fbab8-f63a-43bb-b1bd-dbdc003b28e7 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b2c1870>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-b17fbab8-f63a-43bb-b1bd-dbdc003b28e7 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 200 len: 287 microversion: 2.1 time: 0.040360 Nov 27 02:02:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 271/822] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:26 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:26 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:02:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-75ab56bb-c024-4ec4-9df9-2e9ff001fd3b tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 204 len: 0 microversion: 2.1 time: 0.122067 Nov 27 02:02:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 280/823] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:02:26 2023] DELETE /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:02:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:26 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-3a027ba0-f22d-4929-97e9-df9b14efc531 req-2fdebd2d-9a4a-454f-88be-6190d6dcf3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-unplugged", "status": "completed", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3a027ba0-f22d-4929-97e9-df9b14efc531 req-2fdebd2d-9a4a-454f-88be-6190d6dcf3c6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3a027ba0-f22d-4929-97e9-df9b14efc531 req-2fdebd2d-9a4a-454f-88be-6190d6dcf3c6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3a027ba0-f22d-4929-97e9-df9b14efc531 req-2fdebd2d-9a4a-454f-88be-6190d6dcf3c6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-3a027ba0-f22d-4929-97e9-df9b14efc531 req-2fdebd2d-9a4a-454f-88be-6190d6dcf3c6 service nova] Creating event network-vif-unplugged:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 02:02:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-3a027ba0-f22d-4929-97e9-df9b14efc531 req-2fdebd2d-9a4a-454f-88be-6190d6dcf3c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047351 Nov 27 02:02:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 272/824] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:27 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:02:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-92788038-b923-4288-9b37-6b701eb4a631 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 200 len: 1556 microversion: 2.1 time: 0.834692 Nov 27 02:02:27 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 273/825] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:02:26 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 1556 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 02:02:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6eb6e0e7-362e-42ba-802c-d1d8a5146180 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b281120>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6eb6e0e7-362e-42ba-802c-d1d8a5146180 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 200 len: 287 microversion: 2.1 time: 0.052880 Nov 27 02:02:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 281/826] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:27 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-812ae028-e47b-4f65-8298-b7275d087256 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b3f0b80>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-812ae028-e47b-4f65-8298-b7275d087256 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] HTTP exception thrown: Snapshot 838ddcef-bbc9-4210-8b7a-ce05b3774840 could not be found. Nov 27 02:02:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-812ae028-e47b-4f65-8298-b7275d087256 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Returning 404 to user: Snapshot 838ddcef-bbc9-4210-8b7a-ce05b3774840 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-812ae028-e47b-4f65-8298-b7275d087256 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840" status: 404 len: 111 microversion: 2.1 time: 0.033018 Nov 27 02:02:28 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 273/827] 10.0.0.210 () {62 vars in 1328 bytes} [Mon Nov 27 02:02:28 2023] GET /compute/v2.1/os-snapshots/838ddcef-bbc9-4210-8b7a-ce05b3774840 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-02dee580-1f67-46a4-9f9f-2b4346209f96 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b0e3250>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-02dee580-1f67-46a4-9f9f-2b4346209f96 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 202 len: 0 microversion: 2.1 time: 0.071044 Nov 27 02:02:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 274/828] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:02:28 2023] DELETE /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:02:28 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ea71d461-4b97-41e0-b17c-f78b8f2becc3 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b03cdc0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:28 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ea71d461-4b97-41e0-b17c-f78b8f2becc3 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 200 len: 344 microversion: 2.1 time: 0.054339 Nov 27 02:02:28 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 282/829] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:02:28 2023] GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-84564941-bc8e-4eb2-9ba5-a3b982a3b5e5 req-9055b51d-4b99-45f1-a9df-e8517969a3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-plugged", "status": "completed", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}, {"server_uuid": "fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7", "name": "network-vif-deleted", "tag": "cedd1abb-f373-4f94-9c4e-077654ea4581"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-84564941-bc8e-4eb2-9ba5-a3b982a3b5e5 req-9055b51d-4b99-45f1-a9df-e8517969a3a8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-84564941-bc8e-4eb2-9ba5-a3b982a3b5e5 req-9055b51d-4b99-45f1-a9df-e8517969a3a8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-84564941-bc8e-4eb2-9ba5-a3b982a3b5e5 req-9055b51d-4b99-45f1-a9df-e8517969a3a8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-84564941-bc8e-4eb2-9ba5-a3b982a3b5e5 req-9055b51d-4b99-45f1-a9df-e8517969a3a8 service nova] Creating event network-vif-plugged:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 02:02:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-84564941-bc8e-4eb2-9ba5-a3b982a3b5e5 req-9055b51d-4b99-45f1-a9df-e8517969a3a8 service nova] Creating event network-vif-deleted:cedd1abb-f373-4f94-9c4e-077654ea4581 for instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 on user Nov 27 02:02:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-84564941-bc8e-4eb2-9ba5-a3b982a3b5e5 req-9055b51d-4b99-45f1-a9df-e8517969a3a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038548 Nov 27 02:02:29 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 274/830] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:29 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f56b5017-dc51-4410-a05c-bb15e2f3c8f6 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364afcf6d0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:29 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-f56b5017-dc51-4410-a05c-bb15e2f3c8f6 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 200 len: 344 microversion: 2.1 time: 0.089236 Nov 27 02:02:29 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 275/831] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:02:29 2023] GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7cffe7ed-8df4-49fb-916c-2fbf81a489d9 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b0a2d40>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-7cffe7ed-8df4-49fb-916c-2fbf81a489d9 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 200 len: 344 microversion: 2.1 time: 0.078058 Nov 27 02:02:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 283/832] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:02:30 2023] GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-60a5139a-fb37-4c34-9530-2a697375be05 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Action: 'create', calling method: .version_select at 0x7f364b2c0820>, body: {"keypair": {"name": "tempest-keypair-1756126364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl1fDPjhhd1h6vYnlCGels10E6h9kMzj18BU3ybxrhUkAsViKrBPD0OEGTaNnnX7EaZ94zo1ts6i5HI67cETcm8HZ7yhBQTxHGpK30LmFMu0nhLuvz4D6RoJM6lhFau1Q=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:31 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-60a5139a-fb37-4c34-9530-2a697375be05 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Getting quotas for project 8751348fc0a34723a00ef1c20a10ca2b. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:02:31 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-60a5139a-fb37-4c34-9530-2a697375be05 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Getting quotas for user ccb2a6cd63c845fdb9a3b48e60d91a8a and project 8751348fc0a34723a00ef1c20a10ca2b. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:02:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-60a5139a-fb37-4c34-9530-2a697375be05 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.229344 Nov 27 02:02:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 275/833] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:02:31 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-105587b0-a9be-4b72-ba2b-7d3d1eac0803 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b0e31c0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:31 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-105587b0-a9be-4b72-ba2b-7d3d1eac0803 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] HTTP exception thrown: Volume 7c3c5fe4-9d37-472e-8c87-5c0173cee41a could not be found. Nov 27 02:02:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-105587b0-a9be-4b72-ba2b-7d3d1eac0803 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Returning 404 to user: Volume 7c3c5fe4-9d37-472e-8c87-5c0173cee41a could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-105587b0-a9be-4b72-ba2b-7d3d1eac0803 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 404 len: 109 microversion: 2.1 time: 0.037727 Nov 27 02:02:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 276/834] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:02:31 2023] GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-1aa0c112-a702-41fa-89cd-5c1b744ade64 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364b2c24d0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-1aa0c112-a702-41fa-89cd-5c1b744ade64 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] HTTP exception thrown: Volume 7c3c5fe4-9d37-472e-8c87-5c0173cee41a could not be found. Nov 27 02:02:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-1aa0c112-a702-41fa-89cd-5c1b744ade64 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Returning 404 to user: Volume 7c3c5fe4-9d37-472e-8c87-5c0173cee41a could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-1aa0c112-a702-41fa-89cd-5c1b744ade64 tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 404 len: 109 microversion: 2.1 time: 0.048816 Nov 27 02:02:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 276/835] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:02:31 2023] DELETE /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 02:02:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-278fad0b-d12a-4dff-9b2d-609508e724ad tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Calling method '.version_select at 0x7f364afcf910>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-278fad0b-d12a-4dff-9b2d-609508e724ad tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] HTTP exception thrown: Volume 7c3c5fe4-9d37-472e-8c87-5c0173cee41a could not be found. Nov 27 02:02:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-278fad0b-d12a-4dff-9b2d-609508e724ad tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] Returning 404 to user: Volume 7c3c5fe4-9d37-472e-8c87-5c0173cee41a could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-278fad0b-d12a-4dff-9b2d-609508e724ad tempest-VolumesSnapshotsTestJSON-460663541 tempest-VolumesSnapshotsTestJSON-460663541-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a" status: 404 len: 109 microversion: 2.1 time: 0.042428 Nov 27 02:02:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 277/836] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:02:31 2023] GET /compute/v2.1/os-volumes/7c3c5fe4-9d37-472e-8c87-5c0173cee41a => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:02:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c85c1dda-5947-4673-b838-75b862942d2a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.222836 Nov 27 02:02:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 284/837] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:02:31 2023] GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb/os-interface => generated 282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:32 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-65823ae7-c9b0-4183-beaa-c169f2d4cf8e req-dae9a7a6-9b06-4380-918f-34ad7c4b78e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa0beed-c279-460c-8dec-9cf2481a8dfb", "tag": "df3bd047-ed97-406d-80b8-09396731e8b9"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-65823ae7-c9b0-4183-beaa-c169f2d4cf8e req-dae9a7a6-9b06-4380-918f-34ad7c4b78e7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-65823ae7-c9b0-4183-beaa-c169f2d4cf8e req-dae9a7a6-9b06-4380-918f-34ad7c4b78e7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:32 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-65823ae7-c9b0-4183-beaa-c169f2d4cf8e req-dae9a7a6-9b06-4380-918f-34ad7c4b78e7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-65823ae7-c9b0-4183-beaa-c169f2d4cf8e req-dae9a7a6-9b06-4380-918f-34ad7c4b78e7 service nova] Creating event network-changed:df3bd047-ed97-406d-80b8-09396731e8b9 for instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb on user Nov 27 02:02:32 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-65823ae7-c9b0-4183-beaa-c169f2d4cf8e req-dae9a7a6-9b06-4380-918f-34ad7c4b78e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050486 Nov 27 02:02:32 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 277/838] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-754c088f-4add-4b63-b266-fbc891d74acb tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb/ips" status: 200 len: 107 microversion: 2.1 time: 0.045984 Nov 27 02:02:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 278/839] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:02:33 2023] GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb/ips => generated 107 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f6d6156-8da1-4e8b-a1f4-1eace5b1a2a9"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Invalid volume: volume 4f6d6156-8da1-4e8b-a1f4-1eace5b1a2a9 is already attached to instances: 749cda36-ac85-44a0-836a-e7b9cea6f106 Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 400 to user: Invalid volume: volume 4f6d6156-8da1-4e8b-a1f4-1eace5b1a2a9 is already attached to instances: 749cda36-ac85-44a0-836a-e7b9cea6f106 {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:02:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c9c309e4-189e-4afa-9f27-958c249ef30d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125841 Nov 27 02:02:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 285/840] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:02:33 2023] POST /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:02:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-836e338f-5240-40ea-b88a-e76727b3c17c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb" status: 204 len: 0 microversion: 2.1 time: 0.128417 Nov 27 02:02:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 278/841] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:02:33 2023] DELETE /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:02:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c881dc87-365f-433e-b748-928f6fe0182c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb" status: 200 len: 1549 microversion: 2.1 time: 0.273193 Nov 27 02:02:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 279/842] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:02:33 2023] GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb => generated 1549 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-86abbd7c-beac-4746-8a5f-0655a72e19ea req-f6fd368e-f164-4870-b8f3-792243f50211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa0beed-c279-460c-8dec-9cf2481a8dfb", "name": "network-vif-unplugged", "status": "completed", "tag": "df3bd047-ed97-406d-80b8-09396731e8b9"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-86abbd7c-beac-4746-8a5f-0655a72e19ea req-f6fd368e-f164-4870-b8f3-792243f50211 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-86abbd7c-beac-4746-8a5f-0655a72e19ea req-f6fd368e-f164-4870-b8f3-792243f50211 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-86abbd7c-beac-4746-8a5f-0655a72e19ea req-f6fd368e-f164-4870-b8f3-792243f50211 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-86abbd7c-beac-4746-8a5f-0655a72e19ea req-f6fd368e-f164-4870-b8f3-792243f50211 service nova] Creating event network-vif-unplugged:df3bd047-ed97-406d-80b8-09396731e8b9 for instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb on user Nov 27 02:02:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-86abbd7c-beac-4746-8a5f-0655a72e19ea req-f6fd368e-f164-4870-b8f3-792243f50211 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038242 Nov 27 02:02:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 286/843] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-583ff374-12fa-4ac7-8b57-1f6ccaac91af req-d8116b5d-b561-4419-871e-8c73bda38480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa0beed-c279-460c-8dec-9cf2481a8dfb", "name": "network-vif-deleted", "tag": "df3bd047-ed97-406d-80b8-09396731e8b9"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-583ff374-12fa-4ac7-8b57-1f6ccaac91af req-d8116b5d-b561-4419-871e-8c73bda38480 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-583ff374-12fa-4ac7-8b57-1f6ccaac91af req-d8116b5d-b561-4419-871e-8c73bda38480 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:34 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-583ff374-12fa-4ac7-8b57-1f6ccaac91af req-d8116b5d-b561-4419-871e-8c73bda38480 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-583ff374-12fa-4ac7-8b57-1f6ccaac91af req-d8116b5d-b561-4419-871e-8c73bda38480 service nova] Creating event network-vif-deleted:df3bd047-ed97-406d-80b8-09396731e8b9 for instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb on user Nov 27 02:02:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-583ff374-12fa-4ac7-8b57-1f6ccaac91af req-d8116b5d-b561-4419-871e-8c73bda38480 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029503 Nov 27 02:02:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 279/844] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1545378995", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "key_name": "tempest-keypair-1756126364", "security_groups": [{"name": "tempest-secgroup-smoke-1214952399"}, {"name": "tempest-securitygroup--929806124"}], "networks": [{"uuid": "33bf491f-8df9-4582-b746-a8bbc6d709b4"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:35 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] validate_networks() for [('33bf491f-8df9-4582-b746-a8bbc6d709b4', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:02:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-2de8b8ac-5dd3-4612-9aad-4d5770bc9be1 req-ba9661c8-037a-47c9-8179-1158006514d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa0beed-c279-460c-8dec-9cf2481a8dfb", "name": "network-vif-plugged", "status": "completed", "tag": "df3bd047-ed97-406d-80b8-09396731e8b9"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-2de8b8ac-5dd3-4612-9aad-4d5770bc9be1 req-ba9661c8-037a-47c9-8179-1158006514d1 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-2de8b8ac-5dd3-4612-9aad-4d5770bc9be1 req-ba9661c8-037a-47c9-8179-1158006514d1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:35 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-2de8b8ac-5dd3-4612-9aad-4d5770bc9be1 req-ba9661c8-037a-47c9-8179-1158006514d1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-2de8b8ac-5dd3-4612-9aad-4d5770bc9be1 req-ba9661c8-037a-47c9-8179-1158006514d1 service nova] Creating event network-vif-plugged:df3bd047-ed97-406d-80b8-09396731e8b9 for instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb on user Nov 27 02:02:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-2de8b8ac-5dd3-4612-9aad-4d5770bc9be1 req-ba9661c8-037a-47c9-8179-1158006514d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031571 Nov 27 02:02:35 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 287/845] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Getting quotas for project 8751348fc0a34723a00ef1c20a10ca2b. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Getting quotas for user ccb2a6cd63c845fdb9a3b48e60d91a8a and project 8751348fc0a34723a00ef1c20a10ca2b. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:02:36 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:02:36 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b551d5dc-9fba-434c-8f53-0f44ac8a4e79 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 450 microversion: 2.1 time: 0.661835 Nov 27 02:02:36 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 280/846] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:02:35 2023] POST /compute/v2.1/servers => generated 450 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:02:36 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-42e60f04-f76c-4a81-87a7-db156b5351c5 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:36 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-42e60f04-f76c-4a81-87a7-db156b5351c5 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:36 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-42e60f04-f76c-4a81-87a7-db156b5351c5 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb2a6cd63c845fdb9a3b48e60d91a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8751348fc0a34723a00ef1c20a10ca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:02:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-42e60f04-f76c-4a81-87a7-db156b5351c5 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0" status: 200 len: 1236 microversion: 2.1 time: 0.062925 Nov 27 02:02:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 280/847] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:02:36 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0 => generated 1236 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:02:38 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c5018d7e-159c-47ce-beb7-881cd040edb4 req-ccfdb9af-cf7e-4cad-bb7d-94784a14870d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a110ae5-60a1-4aa7-9018-5b57f10bebd0", "tag": "bdf37155-3ad4-484a-853d-a94a63df3cc0"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c5018d7e-159c-47ce-beb7-881cd040edb4 req-ccfdb9af-cf7e-4cad-bb7d-94784a14870d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c5018d7e-159c-47ce-beb7-881cd040edb4 req-ccfdb9af-cf7e-4cad-bb7d-94784a14870d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c5018d7e-159c-47ce-beb7-881cd040edb4 req-ccfdb9af-cf7e-4cad-bb7d-94784a14870d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:38 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-c5018d7e-159c-47ce-beb7-881cd040edb4 req-ccfdb9af-cf7e-4cad-bb7d-94784a14870d service nova] Creating event network-changed:bdf37155-3ad4-484a-853d-a94a63df3cc0 for instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 on user Nov 27 02:02:38 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c5018d7e-159c-47ce-beb7-881cd040edb4 req-ccfdb9af-cf7e-4cad-bb7d-94784a14870d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030298 Nov 27 02:02:38 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 288/848] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-d5e1f4d5-ab72-4b9e-b14a-331e4c2d845c req-b09549ff-a8ce-421a-8c1e-e38aa69a1d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a110ae5-60a1-4aa7-9018-5b57f10bebd0", "name": "network-vif-plugged", "status": "completed", "tag": "bdf37155-3ad4-484a-853d-a94a63df3cc0"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d5e1f4d5-ab72-4b9e-b14a-331e4c2d845c req-b09549ff-a8ce-421a-8c1e-e38aa69a1d07 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d5e1f4d5-ab72-4b9e-b14a-331e4c2d845c req-b09549ff-a8ce-421a-8c1e-e38aa69a1d07 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-d5e1f4d5-ab72-4b9e-b14a-331e4c2d845c req-b09549ff-a8ce-421a-8c1e-e38aa69a1d07 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-d5e1f4d5-ab72-4b9e-b14a-331e4c2d845c req-b09549ff-a8ce-421a-8c1e-e38aa69a1d07 service nova] Creating event network-vif-plugged:bdf37155-3ad4-484a-853d-a94a63df3cc0 for instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 on user Nov 27 02:02:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-d5e1f4d5-ab72-4b9e-b14a-331e4c2d845c req-b09549ff-a8ce-421a-8c1e-e38aa69a1d07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038487 Nov 27 02:02:40 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 281/849] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:42 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-a9f26412-3fe0-4e19-a267-7cf8618e76b4 req-04f090db-8fd6-4171-a08b-525e318be5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a110ae5-60a1-4aa7-9018-5b57f10bebd0", "name": "network-vif-plugged", "status": "completed", "tag": "bdf37155-3ad4-484a-853d-a94a63df3cc0"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a9f26412-3fe0-4e19-a267-7cf8618e76b4 req-04f090db-8fd6-4171-a08b-525e318be5d4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a9f26412-3fe0-4e19-a267-7cf8618e76b4 req-04f090db-8fd6-4171-a08b-525e318be5d4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-a9f26412-3fe0-4e19-a267-7cf8618e76b4 req-04f090db-8fd6-4171-a08b-525e318be5d4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-a9f26412-3fe0-4e19-a267-7cf8618e76b4 req-04f090db-8fd6-4171-a08b-525e318be5d4 service nova] Creating event network-vif-plugged:bdf37155-3ad4-484a-853d-a94a63df3cc0 for instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 on user Nov 27 02:02:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-a9f26412-3fe0-4e19-a267-7cf8618e76b4 req-04f090db-8fd6-4171-a08b-525e318be5d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041764 Nov 27 02:02:42 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 281/850] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d03626f5-cb32-433d-9920-2e6324d2b492 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063816 Nov 27 02:02:44 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 289/851] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:02:44 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:44 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:02:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-05cd75c9-12f6-4c1d-b9c8-eb8985ba0cf0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 204 len: 0 microversion: 2.1 time: 0.121653 Nov 27 02:02:44 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 282/852] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:02:44 2023] DELETE /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:44 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:02:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3ef2417e-324c-4270-abb5-c3d594ad7ba3 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 200 len: 1658 microversion: 2.1 time: 0.260956 Nov 27 02:02:44 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 282/853] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:02:44 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 1658 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-006c1566-ef5c-4444-8359-8d2c6bc2a56e req-efae9f1c-e738-48f7-8ea2-32c110af6a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-unplugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-006c1566-ef5c-4444-8359-8d2c6bc2a56e req-efae9f1c-e738-48f7-8ea2-32c110af6a3e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-006c1566-ef5c-4444-8359-8d2c6bc2a56e req-efae9f1c-e738-48f7-8ea2-32c110af6a3e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-006c1566-ef5c-4444-8359-8d2c6bc2a56e req-efae9f1c-e738-48f7-8ea2-32c110af6a3e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-006c1566-ef5c-4444-8359-8d2c6bc2a56e req-efae9f1c-e738-48f7-8ea2-32c110af6a3e service nova] Creating event network-vif-unplugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 02:02:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-006c1566-ef5c-4444-8359-8d2c6bc2a56e req-efae9f1c-e738-48f7-8ea2-32c110af6a3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032080 Nov 27 02:02:44 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 290/854] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:46 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-8615ba10-84be-4875-8846-4e5703632e98 req-a9d740d3-17b9-45d0-a2c8-8e4821323fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-deleted", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:46 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:46 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8615ba10-84be-4875-8846-4e5703632e98 req-a9d740d3-17b9-45d0-a2c8-8e4821323fea service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8615ba10-84be-4875-8846-4e5703632e98 req-a9d740d3-17b9-45d0-a2c8-8e4821323fea service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8615ba10-84be-4875-8846-4e5703632e98 req-a9d740d3-17b9-45d0-a2c8-8e4821323fea service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:46 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-8615ba10-84be-4875-8846-4e5703632e98 req-a9d740d3-17b9-45d0-a2c8-8e4821323fea service nova] Creating event network-vif-deleted:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 02:02:46 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-8615ba10-84be-4875-8846-4e5703632e98 req-a9d740d3-17b9-45d0-a2c8-8e4821323fea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041187 Nov 27 02:02:46 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 283/855] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:02:46 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-eba03c03-74f2-4b60-aaec-a832591a0930 req-ddf45a57-aced-47b5-87cc-d07c112a690f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec0b5b94-88d1-4edf-a4b4-ea709cd5a542"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:02:46 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:02:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-eba03c03-74f2-4b60-aaec-a832591a0930 req-ddf45a57-aced-47b5-87cc-d07c112a690f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:02:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-eba03c03-74f2-4b60-aaec-a832591a0930 req-ddf45a57-aced-47b5-87cc-d07c112a690f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:02:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-eba03c03-74f2-4b60-aaec-a832591a0930 req-ddf45a57-aced-47b5-87cc-d07c112a690f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:02:46 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-eba03c03-74f2-4b60-aaec-a832591a0930 req-ddf45a57-aced-47b5-87cc-d07c112a690f service nova] Creating event network-vif-plugged:ec0b5b94-88d1-4edf-a4b4-ea709cd5a542 for instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc on user Nov 27 02:02:46 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-eba03c03-74f2-4b60-aaec-a832591a0930 req-ddf45a57-aced-47b5-87cc-d07c112a690f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033271 Nov 27 02:02:46 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 283/856] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "d14b9e89-445b-45a2-af45-20679647d272"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:07 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lazy-loading 'flavor' on Instance uuid 22eebc55-69ce-4552-9a26-fc26a7d9d40f {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:03:07 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4f2c0ef0-c413-4f31-a293-88b55980896d tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f/action" status: 200 len: 29 microversion: 2.87 time: 0.392733 Nov 27 02:03:07 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 291/857] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 02:03:07 2023] POST /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f/action => generated 29 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:08 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d6d32495-813b-4a06-acb1-52d5bd46f3e1 req-4a313d9f-e268-4ae5-8a16-ca698ff0cbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-unplugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:08 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:08 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d6d32495-813b-4a06-acb1-52d5bd46f3e1 req-4a313d9f-e268-4ae5-8a16-ca698ff0cbe6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d6d32495-813b-4a06-acb1-52d5bd46f3e1 req-4a313d9f-e268-4ae5-8a16-ca698ff0cbe6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d6d32495-813b-4a06-acb1-52d5bd46f3e1 req-4a313d9f-e268-4ae5-8a16-ca698ff0cbe6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:08 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d6d32495-813b-4a06-acb1-52d5bd46f3e1 req-4a313d9f-e268-4ae5-8a16-ca698ff0cbe6 service nova] Creating event network-vif-unplugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:03:08 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-d6d32495-813b-4a06-acb1-52d5bd46f3e1 req-4a313d9f-e268-4ae5-8a16-ca698ff0cbe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048646 Nov 27 02:03:08 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 284/858] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:08 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:08 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-494c4d45-b649-4192-af51-f1957a6bdc0e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 200 len: 1773 microversion: 2.87 time: 0.810739 Nov 27 02:03:08 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 284/859] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:03:07 2023] GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 1773 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:03:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-unplugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:03:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:03:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:03:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Creating event network-vif-unplugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:03:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:03:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-61c5f252-0bf0-4d9a-a49e-8f7108279eba req-d2312b6b-55ee-4825-b49e-da6eb76ebded service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.040150 Nov 27 02:03:10 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 292/860] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:13 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-bb5c9a71-1820-4e65-8e67-e137445d7946 req-6e032cea-cefc-470b-8d31-81e9b2a3c2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-bb5c9a71-1820-4e65-8e67-e137445d7946 req-6e032cea-cefc-470b-8d31-81e9b2a3c2c5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-bb5c9a71-1820-4e65-8e67-e137445d7946 req-6e032cea-cefc-470b-8d31-81e9b2a3c2c5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-bb5c9a71-1820-4e65-8e67-e137445d7946 req-6e032cea-cefc-470b-8d31-81e9b2a3c2c5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-bb5c9a71-1820-4e65-8e67-e137445d7946 req-6e032cea-cefc-470b-8d31-81e9b2a3c2c5 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:03:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-bb5c9a71-1820-4e65-8e67-e137445d7946 req-6e032cea-cefc-470b-8d31-81e9b2a3c2c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037402 Nov 27 02:03:13 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 285/861] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-4e0d9262-967a-4430-ace6-2a4e9b079ee8 req-5d337cc5-3025-4bf3-91b6-4e6be8791c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e0d9262-967a-4430-ace6-2a4e9b079ee8 req-5d337cc5-3025-4bf3-91b6-4e6be8791c97 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e0d9262-967a-4430-ace6-2a4e9b079ee8 req-5d337cc5-3025-4bf3-91b6-4e6be8791c97 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e0d9262-967a-4430-ace6-2a4e9b079ee8 req-5d337cc5-3025-4bf3-91b6-4e6be8791c97 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4e0d9262-967a-4430-ace6-2a4e9b079ee8 req-5d337cc5-3025-4bf3-91b6-4e6be8791c97 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:03:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-4e0d9262-967a-4430-ace6-2a4e9b079ee8 req-5d337cc5-3025-4bf3-91b6-4e6be8791c97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028717 Nov 27 02:03:15 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 285/862] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:17 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] HTTP exception thrown: Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 could not be found. Nov 27 02:03:17 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Returning 404 to user: Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:03:17 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-de45afbb-82a2-4237-b26f-fdaabb7e6e33 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 404 len: 111 microversion: 2.1 time: 0.058659 Nov 27 02:03:17 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 293/863] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:03:17 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] HTTP exception thrown: Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 could not be found. Nov 27 02:03:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Returning 404 to user: Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:03:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d941ec1e-88b7-41ed-a6be-d92317d70e09 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 404 len: 111 microversion: 2.1 time: 0.039669 Nov 27 02:03:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 286/864] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:03:17 2023] DELETE /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] HTTP exception thrown: Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 could not be found. Nov 27 02:03:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Returning 404 to user: Instance fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:03:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4631794b-5909-45c6-b48a-67fe11c0a3a5 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7" status: 404 len: 111 microversion: 2.1 time: 0.034321 Nov 27 02:03:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 286/865] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:03:17 2023] GET /compute/v2.1/servers/fdc4e38f-aa47-4d28-b940-72e7a5d3fbc7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:20 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:03:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-42c4999d-ce74-438f-8885-8c004404d130 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 204 len: 0 microversion: 2.1 time: 0.166301 Nov 27 02:03:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 294/866] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:03:20 2023] DELETE /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-87bd0f4a-dd75-47e4-8bbd-4e819734cbe4 req-55f2c157-ba0a-41ce-b374-228f98831496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163993f6-3b37-40ff-9372-37f866d28180", "name": "network-vif-unplugged", "status": "completed", "tag": "2e93035c-a4c4-44f1-af80-c57fb2da8038"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-87bd0f4a-dd75-47e4-8bbd-4e819734cbe4 req-55f2c157-ba0a-41ce-b374-228f98831496 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-87bd0f4a-dd75-47e4-8bbd-4e819734cbe4 req-55f2c157-ba0a-41ce-b374-228f98831496 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-87bd0f4a-dd75-47e4-8bbd-4e819734cbe4 req-55f2c157-ba0a-41ce-b374-228f98831496 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:21 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d1d312ea9224e4b9e57e5576276a485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a6f8db8baf4e9988fc1ca048107122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-87bd0f4a-dd75-47e4-8bbd-4e819734cbe4 req-55f2c157-ba0a-41ce-b374-228f98831496 service nova] Creating event network-vif-unplugged:2e93035c-a4c4-44f1-af80-c57fb2da8038 for instance 163993f6-3b37-40ff-9372-37f866d28180 on user Nov 27 02:03:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-87bd0f4a-dd75-47e4-8bbd-4e819734cbe4 req-55f2c157-ba0a-41ce-b374-228f98831496 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038124 Nov 27 02:03:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 287/867] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:21 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-74386d5e-3436-49b5-8a29-0d2213d7c97a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 200 len: 1548 microversion: 2.1 time: 0.299048 Nov 27 02:03:21 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 287/868] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:03:21 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 1548 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:03:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c95cedee-5837-46a6-a155-63b737044053 req-eafd5f78-81bd-4d71-a963-ebdc629b7f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163993f6-3b37-40ff-9372-37f866d28180", "name": "network-vif-deleted", "tag": "2e93035c-a4c4-44f1-af80-c57fb2da8038"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c95cedee-5837-46a6-a155-63b737044053 req-eafd5f78-81bd-4d71-a963-ebdc629b7f11 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c95cedee-5837-46a6-a155-63b737044053 req-eafd5f78-81bd-4d71-a963-ebdc629b7f11 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c95cedee-5837-46a6-a155-63b737044053 req-eafd5f78-81bd-4d71-a963-ebdc629b7f11 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-c95cedee-5837-46a6-a155-63b737044053 req-eafd5f78-81bd-4d71-a963-ebdc629b7f11 service nova] Creating event network-vif-deleted:2e93035c-a4c4-44f1-af80-c57fb2da8038 for instance 163993f6-3b37-40ff-9372-37f866d28180 on user Nov 27 02:03:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c95cedee-5837-46a6-a155-63b737044053 req-eafd5f78-81bd-4d71-a963-ebdc629b7f11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Nov 27 02:03:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 295/869] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:23 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-a9fb65f1-4090-41da-8c33-ec19d4210592 req-d99dadfa-4717-4044-ae84-b8adbec6b0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163993f6-3b37-40ff-9372-37f866d28180", "name": "network-vif-plugged", "status": "completed", "tag": "2e93035c-a4c4-44f1-af80-c57fb2da8038"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a9fb65f1-4090-41da-8c33-ec19d4210592 req-d99dadfa-4717-4044-ae84-b8adbec6b0ce service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a9fb65f1-4090-41da-8c33-ec19d4210592 req-d99dadfa-4717-4044-ae84-b8adbec6b0ce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a9fb65f1-4090-41da-8c33-ec19d4210592 req-d99dadfa-4717-4044-ae84-b8adbec6b0ce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-a9fb65f1-4090-41da-8c33-ec19d4210592 req-d99dadfa-4717-4044-ae84-b8adbec6b0ce service nova] Creating event network-vif-plugged:2e93035c-a4c4-44f1-af80-c57fb2da8038 for instance 163993f6-3b37-40ff-9372-37f866d28180 on user Nov 27 02:03:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-a9fb65f1-4090-41da-8c33-ec19d4210592 req-d99dadfa-4717-4044-ae84-b8adbec6b0ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047537 Nov 27 02:03:23 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 288/870] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb could not be found. Nov 27 02:03:23 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:03:23 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-440be5ad-a190-4bdd-9c40-4d13fac3ef8d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb" status: 404 len: 111 microversion: 2.1 time: 0.053110 Nov 27 02:03:23 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 288/871] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:03:23 2023] GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:03:23 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b0a5f998-da41-41b5-86ab-ac2d6e703c0b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '.version_select at 0x7f364b0a1630>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b0a5f998-da41-41b5-86ab-ac2d6e703c0b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164925591" status: 202 len: 0 microversion: 2.1 time: 0.038685 Nov 27 02:03:23 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 296/872] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 02:03:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164925591 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:24 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lazy-loading 'services' on Instance uuid 749cda36-ac85-44a0-836a-e7b9cea6f106 {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:03:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-eb651d49-e278-4d81-a5c8-0256b901c267 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-volume_attachments/4f6d6156-8da1-4e8b-a1f4-1eace5b1a2a9" status: 202 len: 0 microversion: 2.1 time: 0.229633 Nov 27 02:03:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 289/873] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:03:24 2023] DELETE /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-volume_attachments/4f6d6156-8da1-4e8b-a1f4-1eace5b1a2a9 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:03:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:24 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a04dd7a3-6ffd-4d5c-a2e9-e32ec0ee703b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090969 Nov 27 02:03:24 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 289/874] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:03:24 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:26 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb2a6cd63c845fdb9a3b48e60d91a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8751348fc0a34723a00ef1c20a10ca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-34a3e54b-2e31-41ee-b974-18e81168718c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0" status: 200 len: 1594 microversion: 2.1 time: 0.249489 Nov 27 02:03:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 297/875] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:03:26 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0 => generated 1594 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=14 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] HTTP exception thrown: Instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc could not be found. Nov 27 02:03:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Returning 404 to user: Instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:03:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7ea10ed9-6112-4514-a271-3bac4f196fd5 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 404 len: 111 microversion: 2.1 time: 0.036791 Nov 27 02:03:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 290/876] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:03:34 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:03:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-853855f2-fd61-4dbc-9bca-8dec4766d259 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '.version_select at 0x7f364b2c0700>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-853855f2-fd61-4dbc-9bca-8dec4766d259 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-73200854" status: 202 len: 0 microversion: 2.1 time: 0.022844 Nov 27 02:03:34 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 290/877] 10.0.0.210 () {62 vars in 1292 bytes} [Mon Nov 27 02:03:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-73200854 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:03:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-31469035-5c86-4b17-9992-a5237b7478a8 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'create', calling method: .version_select at 0x7f364b4e5f30>, body: {"keypair": {"name": "tempest-keypair-844773472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcx8oCibtuSYAGJYvSlOreWLWWGrSFdOo+awn8PU1T0jdA/U+Tmh4KJWol/oqfoV/Cp+HhGOlrOYq4Svj5EEZp36AOC0y5uBKZvVFyGihEg41RdXh1zloZDhVp+90YRog=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:35 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-31469035-5c86-4b17-9992-a5237b7478a8 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Getting quotas for project 0f58fef2b9a44c91b1990c8b5b07212c. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:03:35 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-31469035-5c86-4b17-9992-a5237b7478a8 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Getting quotas for user 98756aa16183475ca8113257bb08da2e and project 0f58fef2b9a44c91b1990c8b5b07212c. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:03:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-31469035-5c86-4b17-9992-a5237b7478a8 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046086 Nov 27 02:03:35 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 298/878] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:03:35 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:37 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-197054443", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "33ae1cca-221f-47fd-aa00-c5bdfe094028"}], "security_groups": [{"name": "tempest-securitygroup--976312394"}], "key_name": "tempest-keypair-844773472", "user_data": "}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:37 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] validate_networks() for [('33ae1cca-221f-47fd-aa00-c5bdfe094028', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Getting quotas for project 0f58fef2b9a44c91b1990c8b5b07212c. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Getting quotas for user 98756aa16183475ca8113257bb08da2e and project 0f58fef2b9a44c91b1990c8b5b07212c. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:03:38 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:03:38 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ed13f094-7ee3-48f2-86c1-ef1210888cea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.666232 Nov 27 02:03:38 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 291/879] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:03:37 2023] POST /compute/v2.1/servers => generated 399 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:03:38 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=20 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:38 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-764d4936-27d6-4a68-9f18-792988dc5bc0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:38 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-764d4936-27d6-4a68-9f18-792988dc5bc0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:38 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-764d4936-27d6-4a68-9f18-792988dc5bc0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-764d4936-27d6-4a68-9f18-792988dc5bc0 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73" status: 200 len: 1228 microversion: 2.1 time: 0.097677 Nov 27 02:03:38 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 291/880] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:03:38 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73 => generated 1228 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:03:40 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c2e134a3-bfcb-4a30-aa11-9aef11471c6a req-ce737147-a33e-498d-930c-313413bf47d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a968a24b-8cb4-4a5e-9d35-23615494eb73", "tag": "4a7b08d0-0b17-4722-b9e2-cef978e3ed18"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c2e134a3-bfcb-4a30-aa11-9aef11471c6a req-ce737147-a33e-498d-930c-313413bf47d4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c2e134a3-bfcb-4a30-aa11-9aef11471c6a req-ce737147-a33e-498d-930c-313413bf47d4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c2e134a3-bfcb-4a30-aa11-9aef11471c6a req-ce737147-a33e-498d-930c-313413bf47d4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-c2e134a3-bfcb-4a30-aa11-9aef11471c6a req-ce737147-a33e-498d-930c-313413bf47d4 service nova] Creating event network-changed:4a7b08d0-0b17-4722-b9e2-cef978e3ed18 for instance a968a24b-8cb4-4a5e-9d35-23615494eb73 on user Nov 27 02:03:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c2e134a3-bfcb-4a30-aa11-9aef11471c6a req-ce737147-a33e-498d-930c-313413bf47d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032736 Nov 27 02:03:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 299/881] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:48 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:48 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:48 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:48 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-b3925d7b-3641-41df-b924-e8eaffa8002b req-5ec0b5bb-52ee-4bbd-9b25-be1435b5a67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a968a24b-8cb4-4a5e-9d35-23615494eb73", "name": "network-vif-plugged", "status": "completed", "tag": "4a7b08d0-0b17-4722-b9e2-cef978e3ed18"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b3925d7b-3641-41df-b924-e8eaffa8002b req-5ec0b5bb-52ee-4bbd-9b25-be1435b5a67c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b3925d7b-3641-41df-b924-e8eaffa8002b req-5ec0b5bb-52ee-4bbd-9b25-be1435b5a67c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:48 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b3925d7b-3641-41df-b924-e8eaffa8002b req-5ec0b5bb-52ee-4bbd-9b25-be1435b5a67c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-b3925d7b-3641-41df-b924-e8eaffa8002b req-5ec0b5bb-52ee-4bbd-9b25-be1435b5a67c service nova] Creating event network-vif-plugged:4a7b08d0-0b17-4722-b9e2-cef978e3ed18 for instance a968a24b-8cb4-4a5e-9d35-23615494eb73 on user Nov 27 02:03:48 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-b3925d7b-3641-41df-b924-e8eaffa8002b req-5ec0b5bb-52ee-4bbd-9b25-be1435b5a67c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046922 Nov 27 02:03:48 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 292/882] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:49 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6451d608-7d97-4505-92c2-ebf9950a9ab8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Action: 'create', calling method: .version_select at 0x7f364b7cba30>, body: {"keypair": {"name": "tempest-keypair-551362897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnr2ar2Z8rIL3h/B8wmg1noJftTTiWFzPEclasbOfEk1KIPC0LKz//M94smqStmldTtXCWgPj0O4g2fSeMsTVUrAqDx+AO3T1DSYiBV3R92P7/12iSEK14f9h6KURv4TQ=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:49 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:49 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:49 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-6451d608-7d97-4505-92c2-ebf9950a9ab8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Getting quotas for project bd748cef1b564d42affdddac5e7e6d82. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:03:49 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-6451d608-7d97-4505-92c2-ebf9950a9ab8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Getting quotas for user 4874ba5054e843be8abb960e24d90c61 and project bd748cef1b564d42affdddac5e7e6d82. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:03:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6451d608-7d97-4505-92c2-ebf9950a9ab8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051056 Nov 27 02:03:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 292/883] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:03:49 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:50 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:03:50 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-8f641ace-26bb-4db7-b836-70b6fdf7eafd req-bb125d90-595b-40a3-973f-f8ae141d066e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a968a24b-8cb4-4a5e-9d35-23615494eb73", "name": "network-vif-plugged", "status": "completed", "tag": "4a7b08d0-0b17-4722-b9e2-cef978e3ed18"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8f641ace-26bb-4db7-b836-70b6fdf7eafd req-bb125d90-595b-40a3-973f-f8ae141d066e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8f641ace-26bb-4db7-b836-70b6fdf7eafd req-bb125d90-595b-40a3-973f-f8ae141d066e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8f641ace-26bb-4db7-b836-70b6fdf7eafd req-bb125d90-595b-40a3-973f-f8ae141d066e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-8f641ace-26bb-4db7-b836-70b6fdf7eafd req-bb125d90-595b-40a3-973f-f8ae141d066e service nova] Creating event network-vif-plugged:4a7b08d0-0b17-4722-b9e2-cef978e3ed18 for instance a968a24b-8cb4-4a5e-9d35-23615494eb73 on user Nov 27 02:03:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-8f641ace-26bb-4db7-b836-70b6fdf7eafd req-bb125d90-595b-40a3-973f-f8ae141d066e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060654 Nov 27 02:03:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 300/884] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1169769676", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "3039617e-0641-46ad-b771-dc68d60f8668"}], "security_groups": [{"name": "tempest-securitygroup--362551219"}], "key_name": "tempest-keypair-551362897", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] validate_networks() for [('3039617e-0641-46ad-b771-dc68d60f8668', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Getting quotas for project bd748cef1b564d42affdddac5e7e6d82. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Getting quotas for user 4874ba5054e843be8abb960e24d90c61 and project bd748cef1b564d42affdddac5e7e6d82. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:03:51 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:03:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3f8bc694-07f7-40ca-93d5-a5a16309813d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.529294 Nov 27 02:03:51 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 293/885] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:03:51 2023] POST /compute/v2.1/servers => generated 403 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:03:51 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-fe5aa99b-b4b7-4ac4-86e3-d14e994ee14d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:51 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-fe5aa99b-b4b7-4ac4-86e3-d14e994ee14d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:51 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-fe5aa99b-b4b7-4ac4-86e3-d14e994ee14d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874ba5054e843be8abb960e24d90c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd748cef1b564d42affdddac5e7e6d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:51 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-fe5aa99b-b4b7-4ac4-86e3-d14e994ee14d tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3" status: 200 len: 1234 microversion: 2.1 time: 0.087194 Nov 27 02:03:51 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 293/886] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:03:51 2023] GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3 => generated 1234 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:03:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-0797f152-0e9a-4c92-a120-98fcee6a7242 req-bac5297a-abde-430f-a8d9-31d61daab81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c298f9-6e41-482f-a459-025232d56ed3", "tag": "4dd769f0-6581-4dc9-b3c0-d810e6f88690"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0797f152-0e9a-4c92-a120-98fcee6a7242 req-bac5297a-abde-430f-a8d9-31d61daab81a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0797f152-0e9a-4c92-a120-98fcee6a7242 req-bac5297a-abde-430f-a8d9-31d61daab81a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0797f152-0e9a-4c92-a120-98fcee6a7242 req-bac5297a-abde-430f-a8d9-31d61daab81a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-0797f152-0e9a-4c92-a120-98fcee6a7242 req-bac5297a-abde-430f-a8d9-31d61daab81a service nova] Creating event network-changed:4dd769f0-6581-4dc9-b3c0-d810e6f88690 for instance e1c298f9-6e41-482f-a459-025232d56ed3 on user Nov 27 02:03:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-0797f152-0e9a-4c92-a120-98fcee6a7242 req-bac5297a-abde-430f-a8d9-31d61daab81a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028898 Nov 27 02:03:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 301/887] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:56 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-f5979e1c-e028-407c-9097-9a58ef38f42e req-14552c2b-c735-4c12-a3ff-c3448ed113ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c298f9-6e41-482f-a459-025232d56ed3", "name": "network-vif-plugged", "status": "completed", "tag": "4dd769f0-6581-4dc9-b3c0-d810e6f88690"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f5979e1c-e028-407c-9097-9a58ef38f42e req-14552c2b-c735-4c12-a3ff-c3448ed113ac service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f5979e1c-e028-407c-9097-9a58ef38f42e req-14552c2b-c735-4c12-a3ff-c3448ed113ac service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-f5979e1c-e028-407c-9097-9a58ef38f42e req-14552c2b-c735-4c12-a3ff-c3448ed113ac service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:56 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-f5979e1c-e028-407c-9097-9a58ef38f42e req-14552c2b-c735-4c12-a3ff-c3448ed113ac service nova] Creating event network-vif-plugged:4dd769f0-6581-4dc9-b3c0-d810e6f88690 for instance e1c298f9-6e41-482f-a459-025232d56ed3 on user Nov 27 02:03:56 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-f5979e1c-e028-407c-9097-9a58ef38f42e req-14552c2b-c735-4c12-a3ff-c3448ed113ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046467 Nov 27 02:03:56 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 294/888] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-b1a4cac8-47d8-4e09-87f9-6c7465b1ad5b req-1be986c1-97e8-4486-b5c8-f5729494ce9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c298f9-6e41-482f-a459-025232d56ed3", "name": "network-vif-plugged", "status": "completed", "tag": "4dd769f0-6581-4dc9-b3c0-d810e6f88690"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:03:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b1a4cac8-47d8-4e09-87f9-6c7465b1ad5b req-1be986c1-97e8-4486-b5c8-f5729494ce9e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b1a4cac8-47d8-4e09-87f9-6c7465b1ad5b req-1be986c1-97e8-4486-b5c8-f5729494ce9e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b1a4cac8-47d8-4e09-87f9-6c7465b1ad5b req-1be986c1-97e8-4486-b5c8-f5729494ce9e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b1a4cac8-47d8-4e09-87f9-6c7465b1ad5b req-1be986c1-97e8-4486-b5c8-f5729494ce9e service nova] Creating event network-vif-plugged:4dd769f0-6581-4dc9-b3c0-d810e6f88690 for instance e1c298f9-6e41-482f-a459-025232d56ed3 on user Nov 27 02:03:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-b1a4cac8-47d8-4e09-87f9-6c7465b1ad5b req-1be986c1-97e8-4486-b5c8-f5729494ce9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033526 Nov 27 02:03:58 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 294/889] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:03:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:03:58 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-f509654b-b6c4-44aa-b333-fde7ee8f072f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 200 len: 1753 microversion: 2.87 time: 0.249884 Nov 27 02:03:58 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 302/890] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:03:58 2023] GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 1753 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] [instance: 163993f6-3b37-40ff-9372-37f866d28180] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] HTTP exception thrown: Instance 163993f6-3b37-40ff-9372-37f866d28180 could not be found. Nov 27 02:04:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Returning 404 to user: Instance 163993f6-3b37-40ff-9372-37f866d28180 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:04:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a5a69c9f-2bd9-484c-8e03-5e6870746d5a tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180" status: 404 len: 111 microversion: 2.1 time: 0.047626 Nov 27 02:04:11 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 295/891] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:04:11 2023] GET /compute/v2.1/servers/163993f6-3b37-40ff-9372-37f866d28180 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 27 02:04:11 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:11 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:11 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:11 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-df23eeeb-329e-47ab-b9af-ae7a460a19e7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] Calling method '.version_select at 0x7f364b2c2dd0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-df23eeeb-329e-47ab-b9af-ae7a460a19e7 tempest-ServerActionsTestOtherA-1470255416 tempest-ServerActionsTestOtherA-1470255416-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334375291" status: 202 len: 0 microversion: 2.1 time: 0.039396 Nov 27 02:04:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 295/892] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 02:04:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334375291 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=12 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8c409eb4-d876-4385-a8e7-93e35c0ed95b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050177 Nov 27 02:04:15 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 303/893] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:04:15 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:15 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:04:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-dbbdc301-26a4-4b84-a315-63b60cd03808 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106" status: 204 len: 0 microversion: 2.1 time: 0.124087 Nov 27 02:04:15 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 296/894] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:04:15 2023] DELETE /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:15 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:04:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3f43f8d4-b24e-456d-af14-68dff4a91f20 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106" status: 200 len: 1667 microversion: 2.1 time: 0.346950 Nov 27 02:04:15 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 296/895] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:04:15 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106 => generated 1667 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-53bb791d-38fb-4d3c-a7f8-b5f5e69559be req-cb627ad8-63a4-4bd9-a08c-b8013643075b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749cda36-ac85-44a0-836a-e7b9cea6f106", "name": "network-vif-unplugged", "status": "completed", "tag": "61e70911-2ed9-4794-ad68-81c843623a01"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-53bb791d-38fb-4d3c-a7f8-b5f5e69559be req-cb627ad8-63a4-4bd9-a08c-b8013643075b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-53bb791d-38fb-4d3c-a7f8-b5f5e69559be req-cb627ad8-63a4-4bd9-a08c-b8013643075b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-53bb791d-38fb-4d3c-a7f8-b5f5e69559be req-cb627ad8-63a4-4bd9-a08c-b8013643075b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-53bb791d-38fb-4d3c-a7f8-b5f5e69559be req-cb627ad8-63a4-4bd9-a08c-b8013643075b service nova] Creating event network-vif-unplugged:61e70911-2ed9-4794-ad68-81c843623a01 for instance 749cda36-ac85-44a0-836a-e7b9cea6f106 on user Nov 27 02:04:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-53bb791d-38fb-4d3c-a7f8-b5f5e69559be req-cb627ad8-63a4-4bd9-a08c-b8013643075b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035268 Nov 27 02:04:15 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 304/896] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:04:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:04:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d8a84a62-65ae-495a-978e-7ca0a1a29f82 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Action: 'create', calling method: .version_select at 0x7f364b0e3250>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-397935266", "metadata": {"Type": "work"}}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:04:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-fa42aa05-adb8-403b-ad88-065785f77ba5 req-9fc44bc6-ce03-426d-bfb1-0ebff15c3dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749cda36-ac85-44a0-836a-e7b9cea6f106", "name": "network-vif-deleted", "tag": "61e70911-2ed9-4794-ad68-81c843623a01"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:04:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-fa42aa05-adb8-403b-ad88-065785f77ba5 req-9fc44bc6-ce03-426d-bfb1-0ebff15c3dde service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-fa42aa05-adb8-403b-ad88-065785f77ba5 req-9fc44bc6-ce03-426d-bfb1-0ebff15c3dde service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-fa42aa05-adb8-403b-ad88-065785f77ba5 req-9fc44bc6-ce03-426d-bfb1-0ebff15c3dde service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-fa42aa05-adb8-403b-ad88-065785f77ba5 req-9fc44bc6-ce03-426d-bfb1-0ebff15c3dde service nova] Creating event network-vif-deleted:61e70911-2ed9-4794-ad68-81c843623a01 for instance 749cda36-ac85-44a0-836a-e7b9cea6f106 on user Nov 27 02:04:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-fa42aa05-adb8-403b-ad88-065785f77ba5 req-9fc44bc6-ce03-426d-bfb1-0ebff15c3dde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049744 Nov 27 02:04:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 297/897] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:04:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d8a84a62-65ae-495a-978e-7ca0a1a29f82 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.580233 Nov 27 02:04:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 297/898] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Nov 27 02:04:16 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 582 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 27 02:04:17 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-80166a74-5333-4e62-8fd2-774750b44c9c tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364b0a2a70>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:17 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-80166a74-5333-4e62-8fd2-774750b44c9c tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 200 len: 352 microversion: 2.1 time: 0.071311 Nov 27 02:04:17 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 305/899] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:17 2023] GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-1b89e9f1-eef6-49bb-abc3-95c56d94e3b7 req-172107eb-9d5f-4075-b96c-1b29defadd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749cda36-ac85-44a0-836a-e7b9cea6f106", "name": "network-vif-plugged", "status": "completed", "tag": "61e70911-2ed9-4794-ad68-81c843623a01"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:04:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1b89e9f1-eef6-49bb-abc3-95c56d94e3b7 req-172107eb-9d5f-4075-b96c-1b29defadd51 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1b89e9f1-eef6-49bb-abc3-95c56d94e3b7 req-172107eb-9d5f-4075-b96c-1b29defadd51 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:17 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-1b89e9f1-eef6-49bb-abc3-95c56d94e3b7 req-172107eb-9d5f-4075-b96c-1b29defadd51 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-1b89e9f1-eef6-49bb-abc3-95c56d94e3b7 req-172107eb-9d5f-4075-b96c-1b29defadd51 service nova] Creating event network-vif-plugged:61e70911-2ed9-4794-ad68-81c843623a01 for instance 749cda36-ac85-44a0-836a-e7b9cea6f106 on user Nov 27 02:04:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-1b89e9f1-eef6-49bb-abc3-95c56d94e3b7 req-172107eb-9d5f-4075-b96c-1b29defadd51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034261 Nov 27 02:04:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 298/900] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:04:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:18 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4883e758-a69e-4723-955f-0e9c5b1dd5e4 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364afccd30>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4883e758-a69e-4723-955f-0e9c5b1dd5e4 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 200 len: 352 microversion: 2.1 time: 0.055042 Nov 27 02:04:18 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 298/901] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:18 2023] GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-177cf4fa-8d65-4dcf-a22e-75d6eb17a3e0 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364b03f520>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-177cf4fa-8d65-4dcf-a22e-75d6eb17a3e0 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 200 len: 353 microversion: 2.1 time: 0.051826 Nov 27 02:04:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 306/902] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:19 2023] GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0a5e0725-cb3d-47ab-a0cf-5241f9e5e541 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364b3908b0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0a5e0725-cb3d-47ab-a0cf-5241f9e5e541 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 200 len: 353 microversion: 2.1 time: 0.057943 Nov 27 02:04:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 299/903] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:19 2023] GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:04:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-83bf4a8d-92d6-44e1-aa06-333e2590796b tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364afcf0a0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-83bf4a8d-92d6-44e1-aa06-333e2590796b tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 202 len: 0 microversion: 2.1 time: 0.067989 Nov 27 02:04:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 299/904] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:04:19 2023] DELETE /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:04:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-39946598-97eb-4aaf-8959-83fdc82470d9 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364af2ae60>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-39946598-97eb-4aaf-8959-83fdc82470d9 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 200 len: 352 microversion: 2.1 time: 0.118793 Nov 27 02:04:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 307/905] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:19 2023] GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:20 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0a169dd9-53e1-4d09-a71b-eae59a4e40ac tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364b2c1bd0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0a169dd9-53e1-4d09-a71b-eae59a4e40ac tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 200 len: 352 microversion: 2.1 time: 0.070892 Nov 27 02:04:20 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 300/906] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:20 2023] GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-269d7cdb-5cea-44ae-bbf8-f48f5dbbff31 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364afcdbd0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-269d7cdb-5cea-44ae-bbf8-f48f5dbbff31 tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 200 len: 352 microversion: 2.1 time: 0.067010 Nov 27 02:04:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 300/907] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:21 2023] GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:23 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ee6bd18b-a495-4348-9e9c-038b7dbd643f tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Calling method '.version_select at 0x7f364b283760>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-ee6bd18b-a495-4348-9e9c-038b7dbd643f tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] HTTP exception thrown: Volume 7fecaadd-c0ba-428a-a954-0ed6befcaa7e could not be found. Nov 27 02:04:23 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ee6bd18b-a495-4348-9e9c-038b7dbd643f tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] Returning 404 to user: Volume 7fecaadd-c0ba-428a-a954-0ed6befcaa7e could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:04:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ee6bd18b-a495-4348-9e9c-038b7dbd643f tempest-VolumesGetTestJSON-808910949 tempest-VolumesGetTestJSON-808910949-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e" status: 404 len: 109 microversion: 2.1 time: 0.034533 Nov 27 02:04:23 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 308/908] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:23 2023] GET /compute/v2.1/os-volumes/7fecaadd-c0ba-428a-a954-0ed6befcaa7e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:04:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:26 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d88890f6-9883-4b4f-a676-566c2a987f18 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.151142 Nov 27 02:04:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 301/909] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:04:26 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-interface => generated 282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:27 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:27 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:27 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-c0b61b55-4b88-4ceb-a531-0ed99a14ade7 req-da21df09-fbda-45d3-8478-00443ce941e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a110ae5-60a1-4aa7-9018-5b57f10bebd0", "tag": "bdf37155-3ad4-484a-853d-a94a63df3cc0"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:04:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c0b61b55-4b88-4ceb-a531-0ed99a14ade7 req-da21df09-fbda-45d3-8478-00443ce941e7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c0b61b55-4b88-4ceb-a531-0ed99a14ade7 req-da21df09-fbda-45d3-8478-00443ce941e7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c0b61b55-4b88-4ceb-a531-0ed99a14ade7 req-da21df09-fbda-45d3-8478-00443ce941e7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c0b61b55-4b88-4ceb-a531-0ed99a14ade7 req-da21df09-fbda-45d3-8478-00443ce941e7 service nova] Creating event network-changed:bdf37155-3ad4-484a-853d-a94a63df3cc0 for instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 on user Nov 27 02:04:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-c0b61b55-4b88-4ceb-a531-0ed99a14ade7 req-da21df09-fbda-45d3-8478-00443ce941e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054192 Nov 27 02:04:27 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 301/910] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:04:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=8 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:27 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb2a6cd63c845fdb9a3b48e60d91a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8751348fc0a34723a00ef1c20a10ca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:04:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6aa50326-9e92-4884-8f77-f4e0cb88a67b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0" status: 200 len: 1594 microversion: 2.1 time: 0.230826 Nov 27 02:04:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 309/911] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:04:27 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0 => generated 1594 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:04:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-db249b99-684b-4915-a61f-05bd8a35a6b6 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364b2c2320>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-db249b99-684b-4915-a61f-05bd8a35a6b6 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/594de353-1260-4665-8b01-a55c0c93d5a3" status: 200 len: 350 microversion: 2.1 time: 0.080358 Nov 27 02:04:28 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 302/912] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:28 2023] GET /compute/v2.1/os-volumes/594de353-1260-4665-8b01-a55c0c93d5a3 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:28 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:04:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-bd1f9cb9-5aa0-4c06-9b8f-a6929ede7180 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73" status: 200 len: 1533 microversion: 2.1 time: 0.271760 Nov 27 02:04:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 302/913] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:04:28 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73 => generated 1533 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:04:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b83f4465-84b5-4791-abd5-b083254a007c tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364b0a2c20>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b83f4465-84b5-4791-abd5-b083254a007c tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9665528b-343b-4a50-9d41-2e9a9f4cf4c2" status: 200 len: 350 microversion: 2.1 time: 0.055028 Nov 27 02:04:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 310/914] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:30 2023] GET /compute/v2.1/os-volumes/9665528b-343b-4a50-9d41-2e9a9f4cf4c2 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0ce70ab-6970-4613-8bae-b42272b128e5"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:04:31 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6b7e4568-bf67-4653-a4ce-11299733b297 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345466 Nov 27 02:04:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 303/915] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:04:31 2023] POST /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d1c5b3f3-4de9-4f86-9bc5-c0563396025b tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364afcdab0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d1c5b3f3-4de9-4f86-9bc5-c0563396025b tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/60469103-b2c5-472c-879d-5b96e44d6865" status: 200 len: 350 microversion: 2.1 time: 0.057487 Nov 27 02:04:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 303/916] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Nov 27 02:04:34 2023] GET /compute/v2.1/os-volumes/60469103-b2c5-472c-879d-5b96e44d6865 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:34 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-10cc18d6-e265-49e8-997b-11543b4ef509 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364b0a00d0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-10cc18d6-e265-49e8-997b-11543b4ef509 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.171693 Nov 27 02:04:34 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 311/917] 10.0.0.210 () {62 vars in 1211 bytes} [Mon Nov 27 02:04:34 2023] GET /compute/v2.1/os-volumes => generated 1033 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 02:04:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-afc0421e-c42c-48cb-b7f3-d551a199af11 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364b2c2cb0>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:34 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-afc0421e-c42c-48cb-b7f3-d551a199af11 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.221989 Nov 27 02:04:34 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 304/918] 10.0.0.210 () {62 vars in 1226 bytes} [Mon Nov 27 02:04:34 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-2aef9f7e-8102-4136-8d75-7087fe1d1879 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364afcf5b0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:34 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-2aef9f7e-8102-4136-8d75-7087fe1d1879 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.102625 Nov 27 02:04:34 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 304/919] 10.0.0.210 () {62 vars in 1211 bytes} [Mon Nov 27 02:04:34 2023] GET /compute/v2.1/os-volumes => generated 1033 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:04:34 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e172d944-1f3f-4788-bba7-3956abcc084c tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364b0a2440>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e172d944-1f3f-4788-bba7-3956abcc084c tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084189 Nov 27 02:04:35 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 312/920] 10.0.0.210 () {62 vars in 1244 bytes} [Mon Nov 27 02:04:34 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-cb6637bd-9286-4d8d-b72f-d667eb31eb3f tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364b393490>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-cb6637bd-9286-4d8d-b72f-d667eb31eb3f tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084574 Nov 27 02:04:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 305/921] 10.0.0.210 () {62 vars in 1247 bytes} [Mon Nov 27 02:04:35 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b8e42f19-7333-4be2-b08f-c74343f75f04 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364b0e0280>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b8e42f19-7333-4be2-b08f-c74343f75f04 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.097130 Nov 27 02:04:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 305/922] 10.0.0.210 () {62 vars in 1232 bytes} [Mon Nov 27 02:04:35 2023] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:04:35 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c22f1e61-9522-4a14-a494-b7c6d958aee4 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364af28dc0>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:35 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c22f1e61-9522-4a14-a494-b7c6d958aee4 tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.474905 Nov 27 02:04:35 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 313/923] 10.0.0.210 () {62 vars in 1265 bytes} [Mon Nov 27 02:04:35 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-81ef6e94-3160-48e4-a15c-d86866046b1c tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] Calling method '.version_select at 0x7f364b4bf130>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-81ef6e94-3160-48e4-a15c-d86866046b1c tempest-VolumesTestJSON-1520736705 tempest-VolumesTestJSON-1520736705-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089698 Nov 27 02:04:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 306/924] 10.0.0.210 () {62 vars in 1232 bytes} [Mon Nov 27 02:04:35 2023] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:42 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874ba5054e843be8abb960e24d90c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd748cef1b564d42affdddac5e7e6d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:04:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-92335a2e-477f-4856-92d9-bac215ee04d6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3" status: 200 len: 1541 microversion: 2.1 time: 0.243273 Nov 27 02:04:42 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 306/925] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:04:41 2023] GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3 => generated 1541 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:54 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lazy-loading 'services' on Instance uuid 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:04:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5fa9284d-3e10-41cb-82ff-6cb7280809f8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments/d0ce70ab-6970-4613-8bae-b42272b128e5" status: 202 len: 0 microversion: 2.1 time: 0.267450 Nov 27 02:04:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 314/926] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:04:54 2023] DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments/d0ce70ab-6970-4613-8bae-b42272b128e5 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-060ed780-12b1-4a51-bfd1-26e72145e13b tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051907 Nov 27 02:04:55 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 307/927] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:04:54 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-651a3290-a083-4269-8d19-5451d9f8bc13 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "POST /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f/action" status: 202 len: 0 microversion: 2.87 time: 0.081973 Nov 27 02:04:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 307/928] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Nov 27 02:04:58 2023] POST /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:04:58 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:04:58 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5481bd78-7499-45fd-889b-f5a3261d203c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 200 len: 1761 microversion: 2.87 time: 0.229163 Nov 27 02:04:58 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 315/929] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:04:58 2023] GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 1761 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:04:59 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-83fdc48c-9cd1-4684-a7b1-cfdc37ee02d5 req-fca67004-b882-4dfe-af83-080c449f7fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-unplugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:04:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-83fdc48c-9cd1-4684-a7b1-cfdc37ee02d5 req-fca67004-b882-4dfe-af83-080c449f7fa9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:04:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-83fdc48c-9cd1-4684-a7b1-cfdc37ee02d5 req-fca67004-b882-4dfe-af83-080c449f7fa9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:04:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-83fdc48c-9cd1-4684-a7b1-cfdc37ee02d5 req-fca67004-b882-4dfe-af83-080c449f7fa9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:04:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-83fdc48c-9cd1-4684-a7b1-cfdc37ee02d5 req-fca67004-b882-4dfe-af83-080c449f7fa9 service nova] Creating event network-vif-unplugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:04:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-83fdc48c-9cd1-4684-a7b1-cfdc37ee02d5 req-fca67004-b882-4dfe-af83-080c449f7fa9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033112 Nov 27 02:04:59 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 308/930] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:04:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:01 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-9fee9c70-be74-4989-a64f-0af02c5dc0a3 req-7e23eb46-b256-4f88-8957-f2620a73a1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9fee9c70-be74-4989-a64f-0af02c5dc0a3 req-7e23eb46-b256-4f88-8957-f2620a73a1f4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9fee9c70-be74-4989-a64f-0af02c5dc0a3 req-7e23eb46-b256-4f88-8957-f2620a73a1f4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-9fee9c70-be74-4989-a64f-0af02c5dc0a3 req-7e23eb46-b256-4f88-8957-f2620a73a1f4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-9fee9c70-be74-4989-a64f-0af02c5dc0a3 req-7e23eb46-b256-4f88-8957-f2620a73a1f4 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:05:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-9fee9c70-be74-4989-a64f-0af02c5dc0a3 req-7e23eb46-b256-4f88-8957-f2620a73a1f4 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:05:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-9fee9c70-be74-4989-a64f-0af02c5dc0a3 req-7e23eb46-b256-4f88-8957-f2620a73a1f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040559 Nov 27 02:05:01 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 308/931] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:03 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-e03742e8-0a0a-4e5f-9899-e27bcca76898 req-149e0c66-bd34-4307-a435-b9273a3bff8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e03742e8-0a0a-4e5f-9899-e27bcca76898 req-149e0c66-bd34-4307-a435-b9273a3bff8f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e03742e8-0a0a-4e5f-9899-e27bcca76898 req-149e0c66-bd34-4307-a435-b9273a3bff8f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e03742e8-0a0a-4e5f-9899-e27bcca76898 req-149e0c66-bd34-4307-a435-b9273a3bff8f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-e03742e8-0a0a-4e5f-9899-e27bcca76898 req-149e0c66-bd34-4307-a435-b9273a3bff8f service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:05:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-e03742e8-0a0a-4e5f-9899-e27bcca76898 req-149e0c66-bd34-4307-a435-b9273a3bff8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037968 Nov 27 02:05:03 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 316/932] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 749cda36-ac85-44a0-836a-e7b9cea6f106 could not be found. Nov 27 02:05:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 749cda36-ac85-44a0-836a-e7b9cea6f106 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:05:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-75743f31-7f92-410d-b558-d7ba18326026 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106" status: 404 len: 111 microversion: 2.1 time: 0.030310 Nov 27 02:05:05 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 309/933] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:05:05 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:05:05 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a57f775b-c984-4d58-8a67-7b8a56e65528 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '.version_select at 0x7f364ae5ab00>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:05 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a57f775b-c984-4d58-8a67-7b8a56e65528 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887569923" status: 202 len: 0 microversion: 2.1 time: 0.034868 Nov 27 02:05:05 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 309/934] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 02:05:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887569923 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:05:06 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-fc5ddbb9-034b-41c3-9445-c6b0174dba19 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: .version_select at 0x7f364af29990>, body: {"keypair": {"name": "tempest-keypair-1344459915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx14fSBXwVn5+3dCh0c5gahcPzBtjJjJGkNSnPTd4n23QQoKTYaAogwXhEqKUkAFDP2T4ZpYSes5dhQfm+h72CxEi5q9IAR5k+8ylU9+Kc6pt2iBH4q7ADdSqak1DQwBg=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:06 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-fc5ddbb9-034b-41c3-9445-c6b0174dba19 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for project 5da185c008a949dca58184441ccb0a41. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:05:06 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-fc5ddbb9-034b-41c3-9445-c6b0174dba19 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for user 82943dfd9046457e9f82f89cba00ff18 and project 5da185c008a949dca58184441ccb0a41. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:05:06 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-fc5ddbb9-034b-41c3-9445-c6b0174dba19 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055899 Nov 27 02:05:06 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 317/935] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:05:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:07 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2005586504", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e82e28e4-25ab-4f21-9e45-49763803697d"}], "security_groups": [{"name": "tempest-securitygroup--258063093"}], "key_name": "tempest-keypair-1344459915", "user_data": "}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] validate_networks() for [('e82e28e4-25ab-4f21-9e45-49763803697d', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for project 5da185c008a949dca58184441ccb0a41. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for user 82943dfd9046457e9f82f89cba00ff18 and project 5da185c008a949dca58184441ccb0a41. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:05:08 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:05:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6a158dbc-4571-425d-a652-412d35bd419b tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.653051 Nov 27 02:05:08 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 310/936] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:05:07 2023] POST /compute/v2.1/servers => generated 399 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:05:08 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-cb5e2369-a552-4e29-861b-3d80f8afbe5a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:08 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-cb5e2369-a552-4e29-861b-3d80f8afbe5a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:08 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-cb5e2369-a552-4e29-861b-3d80f8afbe5a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:05:08 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-cb5e2369-a552-4e29-861b-3d80f8afbe5a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9" status: 200 len: 1234 microversion: 2.1 time: 0.199661 Nov 27 02:05:08 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 310/937] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:05:08 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9 => generated 1234 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:05:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-34a0ab13-766f-4bdd-9a77-db9a88fc1ef6 req-567ac282-e3fe-4055-a1e4-ee708b75b30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52edffde-5d81-4b3e-9e14-6558bec163f9", "tag": "64e8b7c0-922f-4a3f-8e35-8f6657a38de6"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-34a0ab13-766f-4bdd-9a77-db9a88fc1ef6 req-567ac282-e3fe-4055-a1e4-ee708b75b30d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-34a0ab13-766f-4bdd-9a77-db9a88fc1ef6 req-567ac282-e3fe-4055-a1e4-ee708b75b30d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-34a0ab13-766f-4bdd-9a77-db9a88fc1ef6 req-567ac282-e3fe-4055-a1e4-ee708b75b30d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-34a0ab13-766f-4bdd-9a77-db9a88fc1ef6 req-567ac282-e3fe-4055-a1e4-ee708b75b30d service nova] Creating event network-changed:64e8b7c0-922f-4a3f-8e35-8f6657a38de6 for instance 52edffde-5d81-4b3e-9e14-6558bec163f9 on user Nov 27 02:05:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-34a0ab13-766f-4bdd-9a77-db9a88fc1ef6 req-567ac282-e3fe-4055-a1e4-ee708b75b30d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035566 Nov 27 02:05:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 318/938] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:13 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-d4b4ef5e-c66f-4d9d-9cd2-bc43e29d7a9b req-949391d6-586d-4a77-bd43-0a61d6427466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52edffde-5d81-4b3e-9e14-6558bec163f9", "name": "network-vif-plugged", "status": "completed", "tag": "64e8b7c0-922f-4a3f-8e35-8f6657a38de6"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d4b4ef5e-c66f-4d9d-9cd2-bc43e29d7a9b req-949391d6-586d-4a77-bd43-0a61d6427466 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d4b4ef5e-c66f-4d9d-9cd2-bc43e29d7a9b req-949391d6-586d-4a77-bd43-0a61d6427466 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-d4b4ef5e-c66f-4d9d-9cd2-bc43e29d7a9b req-949391d6-586d-4a77-bd43-0a61d6427466 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-d4b4ef5e-c66f-4d9d-9cd2-bc43e29d7a9b req-949391d6-586d-4a77-bd43-0a61d6427466 service nova] Creating event network-vif-plugged:64e8b7c0-922f-4a3f-8e35-8f6657a38de6 for instance 52edffde-5d81-4b3e-9e14-6558bec163f9 on user Nov 27 02:05:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-d4b4ef5e-c66f-4d9d-9cd2-bc43e29d7a9b req-949391d6-586d-4a77-bd43-0a61d6427466 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062437 Nov 27 02:05:13 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 311/939] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:15 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-0d04a212-97ab-4b94-b173-7bab852b403b req-51026ce4-7f98-43fe-8a52-f661068fcd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52edffde-5d81-4b3e-9e14-6558bec163f9", "name": "network-vif-plugged", "status": "completed", "tag": "64e8b7c0-922f-4a3f-8e35-8f6657a38de6"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:15 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d04a212-97ab-4b94-b173-7bab852b403b req-51026ce4-7f98-43fe-8a52-f661068fcd75 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d04a212-97ab-4b94-b173-7bab852b403b req-51026ce4-7f98-43fe-8a52-f661068fcd75 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:15 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-0d04a212-97ab-4b94-b173-7bab852b403b req-51026ce4-7f98-43fe-8a52-f661068fcd75 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-0d04a212-97ab-4b94-b173-7bab852b403b req-51026ce4-7f98-43fe-8a52-f661068fcd75 service nova] Creating event network-vif-plugged:64e8b7c0-922f-4a3f-8e35-8f6657a38de6 for instance 52edffde-5d81-4b3e-9e14-6558bec163f9 on user Nov 27 02:05:15 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-0d04a212-97ab-4b94-b173-7bab852b403b req-51026ce4-7f98-43fe-8a52-f661068fcd75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035880 Nov 27 02:05:15 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 311/940] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-359971647", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "c6ff7fc3-6536-49a3-aa44-67a01786a630"}]}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:27 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] validate_networks() for [('c6ff7fc3-6536-49a3-aa44-67a01786a630', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Getting quotas for project 76c187845e2645e3bcf55d62c94ff431. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Getting quotas for user 8027d765937b430d9fbcdbc44f7dede5 and project 76c187845e2645e3bcf55d62c94ff431. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:05:28 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: a3be4e2a-a586-45fd-b032-db434ecf6d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:05:28 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-68c0141a-dc41-422c-bd9f-62aae5378507 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.760039 Nov 27 02:05:28 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 319/941] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:05:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:05:28 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:28 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:28 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:28 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=14 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-27c0eb7f-d94b-4f19-a248-b7ec734eb663 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:28 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-27c0eb7f-d94b-4f19-a248-b7ec734eb663 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: a3be4e2a-a586-45fd-b032-db434ecf6d4a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:28 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-27c0eb7f-d94b-4f19-a248-b7ec734eb663 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027d765937b430d9fbcdbc44f7dede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c187845e2645e3bcf55d62c94ff431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:05:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-27c0eb7f-d94b-4f19-a248-b7ec734eb663 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a" status: 200 len: 1205 microversion: 2.1 time: 0.066626 Nov 27 02:05:28 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 312/942] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:05:28 2023] GET /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a => generated 1205 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-10f38abd-f3ff-404d-a13f-e78c2ec41910 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.187260 Nov 27 02:05:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 312/943] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:05:28 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-interface => generated 283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-ab6af0b2-081c-4622-be0c-0b19d82ea2cf req-125113d1-34b0-4289-9489-5a8f934d6cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a968a24b-8cb4-4a5e-9d35-23615494eb73", "tag": "4a7b08d0-0b17-4722-b9e2-cef978e3ed18"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ab6af0b2-081c-4622-be0c-0b19d82ea2cf req-125113d1-34b0-4289-9489-5a8f934d6cae service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ab6af0b2-081c-4622-be0c-0b19d82ea2cf req-125113d1-34b0-4289-9489-5a8f934d6cae service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ab6af0b2-081c-4622-be0c-0b19d82ea2cf req-125113d1-34b0-4289-9489-5a8f934d6cae service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ab6af0b2-081c-4622-be0c-0b19d82ea2cf req-125113d1-34b0-4289-9489-5a8f934d6cae service nova] Creating event network-changed:4a7b08d0-0b17-4722-b9e2-cef978e3ed18 for instance a968a24b-8cb4-4a5e-9d35-23615494eb73 on user Nov 27 02:05:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-ab6af0b2-081c-4622-be0c-0b19d82ea2cf req-125113d1-34b0-4289-9489-5a8f934d6cae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031641 Nov 27 02:05:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 320/944] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:30 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3f2e80f9-47c1-42f1-b0e6-a1d24d84575e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/ips" status: 200 len: 104 microversion: 2.1 time: 0.033378 Nov 27 02:05:30 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 313/945] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:05:30 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/ips => generated 104 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:32 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-dd4125fc-851f-4cec-9b53-4af5b17a70db req-e0561f71-8fd4-4611-8615-25b555ec89b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3be4e2a-a586-45fd-b032-db434ecf6d4a", "tag": "3dfdd2f7-5d38-486c-a0db-cc3e125ed498"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-dd4125fc-851f-4cec-9b53-4af5b17a70db req-e0561f71-8fd4-4611-8615-25b555ec89b4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-dd4125fc-851f-4cec-9b53-4af5b17a70db req-e0561f71-8fd4-4611-8615-25b555ec89b4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:32 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-dd4125fc-851f-4cec-9b53-4af5b17a70db req-e0561f71-8fd4-4611-8615-25b555ec89b4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-dd4125fc-851f-4cec-9b53-4af5b17a70db req-e0561f71-8fd4-4611-8615-25b555ec89b4 service nova] Creating event network-changed:3dfdd2f7-5d38-486c-a0db-cc3e125ed498 for instance a3be4e2a-a586-45fd-b032-db434ecf6d4a on user Nov 27 02:05:32 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-dd4125fc-851f-4cec-9b53-4af5b17a70db req-e0561f71-8fd4-4611-8615-25b555ec89b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032522 Nov 27 02:05:32 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 313/946] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0998c828-96dd-4f7a-916d-824df182ac69"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:33 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-894facac-2e17-4185-b6ca-0025eddb22ec tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323105 Nov 27 02:05:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 321/947] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:05:33 2023] POST /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-e4d17b36-d4cb-4198-ba7a-d56b6c1bbaa6 req-554ee930-649e-473f-9027-ebc2e3b919c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3be4e2a-a586-45fd-b032-db434ecf6d4a", "name": "network-vif-plugged", "status": "completed", "tag": "3dfdd2f7-5d38-486c-a0db-cc3e125ed498"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e4d17b36-d4cb-4198-ba7a-d56b6c1bbaa6 req-554ee930-649e-473f-9027-ebc2e3b919c4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e4d17b36-d4cb-4198-ba7a-d56b6c1bbaa6 req-554ee930-649e-473f-9027-ebc2e3b919c4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e4d17b36-d4cb-4198-ba7a-d56b6c1bbaa6 req-554ee930-649e-473f-9027-ebc2e3b919c4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e4d17b36-d4cb-4198-ba7a-d56b6c1bbaa6 req-554ee930-649e-473f-9027-ebc2e3b919c4 service nova] Creating event network-vif-plugged:3dfdd2f7-5d38-486c-a0db-cc3e125ed498 for instance a3be4e2a-a586-45fd-b032-db434ecf6d4a on user Nov 27 02:05:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-e4d17b36-d4cb-4198-ba7a-d56b6c1bbaa6 req-554ee930-649e-473f-9027-ebc2e3b919c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100992 Nov 27 02:05:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 314/948] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-3a9e809a-bcb8-421a-a5f1-4d9a3783d183 req-4b7f2972-2b90-4ddd-83a4-eee0b2e0ad5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3be4e2a-a586-45fd-b032-db434ecf6d4a", "name": "network-vif-plugged", "status": "completed", "tag": "3dfdd2f7-5d38-486c-a0db-cc3e125ed498"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3a9e809a-bcb8-421a-a5f1-4d9a3783d183 req-4b7f2972-2b90-4ddd-83a4-eee0b2e0ad5f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3a9e809a-bcb8-421a-a5f1-4d9a3783d183 req-4b7f2972-2b90-4ddd-83a4-eee0b2e0ad5f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3a9e809a-bcb8-421a-a5f1-4d9a3783d183 req-4b7f2972-2b90-4ddd-83a4-eee0b2e0ad5f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-3a9e809a-bcb8-421a-a5f1-4d9a3783d183 req-4b7f2972-2b90-4ddd-83a4-eee0b2e0ad5f service nova] Creating event network-vif-plugged:3dfdd2f7-5d38-486c-a0db-cc3e125ed498 for instance a3be4e2a-a586-45fd-b032-db434ecf6d4a on user Nov 27 02:05:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-3a9e809a-bcb8-421a-a5f1-4d9a3783d183 req-4b7f2972-2b90-4ddd-83a4-eee0b2e0ad5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031199 Nov 27 02:05:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 314/949] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8eaca356-b6ee-4bc0-adc7-bb86857f21dd tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.190439 Nov 27 02:05:42 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 322/950] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:05:42 2023] GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3/os-interface => generated 282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7af175b1-4e94-4f2b-a760-f6cacb2119dc tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120333 Nov 27 02:05:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 315/951] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:05:43 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:43 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-8312f097-0e6d-4167-ad6d-e3f780e9a959 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/0998c828-96dd-4f7a-916d-824df182ac69" status: 200 len: 194 microversion: 2.1 time: 0.058256 Nov 27 02:05:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 315/952] 10.0.0.210 () {62 vars in 1490 bytes} [Mon Nov 27 02:05:43 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/0998c828-96dd-4f7a-916d-824df182ac69 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-5eb174f2-2dee-4da0-8760-1d0a4e2ce2e4 req-7c99d811-d11e-42b1-8493-967f0f18e84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c298f9-6e41-482f-a459-025232d56ed3", "tag": "4dd769f0-6581-4dc9-b3c0-d810e6f88690"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5eb174f2-2dee-4da0-8760-1d0a4e2ce2e4 req-7c99d811-d11e-42b1-8493-967f0f18e84d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5eb174f2-2dee-4da0-8760-1d0a4e2ce2e4 req-7c99d811-d11e-42b1-8493-967f0f18e84d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:43 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5eb174f2-2dee-4da0-8760-1d0a4e2ce2e4 req-7c99d811-d11e-42b1-8493-967f0f18e84d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-5eb174f2-2dee-4da0-8760-1d0a4e2ce2e4 req-7c99d811-d11e-42b1-8493-967f0f18e84d service nova] Creating event network-changed:4dd769f0-6581-4dc9-b3c0-d810e6f88690 for instance e1c298f9-6e41-482f-a459-025232d56ed3 on user Nov 27 02:05:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-5eb174f2-2dee-4da0-8760-1d0a4e2ce2e4 req-7c99d811-d11e-42b1-8493-967f0f18e84d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042693 Nov 27 02:05:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 323/953] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:05:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25ab90a3-9f6c-4f87-a7f1-59f18747a6f8", "device": "/dev/vdb"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-44975883-758b-4e30-8963-544f9510c1b6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348682 Nov 27 02:05:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 316/954] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:05:43 2023] POST /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:45 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:45 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:45 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:45 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a1626321-b3da-4a63-977f-d5ca1ce1f1df tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043893 Nov 27 02:05:45 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 316/955] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:05:45 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:05:45 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "970ec924-cbd5-4aca-bbb6-e5543b956274"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:45 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-41d262d2-a738-4ef2-9aa2-d180ab3d2832 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375650 Nov 27 02:05:46 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 324/956] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:05:45 2023] POST /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:48 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05111f97-ab78-421a-9d0d-cdee1aaf5f64"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:05:48 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:48 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:48 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ee1ed596-988e-4cad-9d39-e50268023618 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362773 Nov 27 02:05:48 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 317/957] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:05:48 2023] POST /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:05:49 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:05:49 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5141da90-c099-47ea-a60e-03a233a10b38 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 200 len: 1767 microversion: 2.87 time: 0.391477 Nov 27 02:05:49 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 317/958] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:05:48 2023] GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 1767 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:05:55 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:55 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:55 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-16878dc7-c1f6-4632-9d56-1fed1881863c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053835 Nov 27 02:05:55 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 325/959] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:05:55 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:55 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:55 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-2f59e5bb-7c69-444c-a150-186e53871fe4 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/0998c828-96dd-4f7a-916d-824df182ac69" status: 200 len: 194 microversion: 2.1 time: 0.048640 Nov 27 02:05:55 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 318/960] 10.0.0.210 () {62 vars in 1490 bytes} [Mon Nov 27 02:05:55 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/0998c828-96dd-4f7a-916d-824df182ac69 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:55 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lazy-loading 'services' on Instance uuid a968a24b-8cb4-4a5e-9d35-23615494eb73 {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:05:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-0087ad98-eb1f-4f82-b055-268b55fe3fa7 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/0998c828-96dd-4f7a-916d-824df182ac69" status: 202 len: 0 microversion: 2.1 time: 0.169706 Nov 27 02:05:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 318/961] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:05:55 2023] DELETE /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/0998c828-96dd-4f7a-916d-824df182ac69 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:05:58 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:58 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:58 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:59 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:05:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-91aaaf79-ac48-40dd-974e-ab7d0fc6993d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9" status: 200 len: 1543 microversion: 2.1 time: 0.204829 Nov 27 02:05:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 326/962] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:05:58 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9 => generated 1543 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:59 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lazy-loading 'services' on Instance uuid 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:05:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d2b1e679-100c-4305-aa65-9793f9953ac3 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments/05111f97-ab78-421a-9d0d-cdee1aaf5f64" status: 202 len: 0 microversion: 2.1 time: 0.190651 Nov 27 02:05:59 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 319/963] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:05:59 2023] DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments/05111f97-ab78-421a-9d0d-cdee1aaf5f64 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:05:59 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:05:59 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:05:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:05:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:05:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:05:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-831d0729-09d0-4c9b-a112-805ea01f5014 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040150 Nov 27 02:05:59 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 319/964] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:05:59 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:12 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lazy-loading 'services' on Instance uuid e1c298f9-6e41-482f-a459-025232d56ed3 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:06:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-714caa9c-e031-49e8-966c-de2560fd9988 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3/os-volume_attachments/25ab90a3-9f6c-4f87-a7f1-59f18747a6f8" status: 202 len: 0 microversion: 2.1 time: 0.208464 Nov 27 02:06:12 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 327/965] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:06:12 2023] DELETE /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3/os-volume_attachments/25ab90a3-9f6c-4f87-a7f1-59f18747a6f8 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=18 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:13 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:06:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-854f3100-02c4-40b5-9230-e104b427c16b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3" status: 204 len: 0 microversion: 2.1 time: 0.127497 Nov 27 02:06:13 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 320/966] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:06:12 2023] DELETE /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=18 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:13 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874ba5054e843be8abb960e24d90c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd748cef1b564d42affdddac5e7e6d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:06:13 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e940fe80-7eb8-4b87-91ac-287044b1eb7f tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3" status: 200 len: 1712 microversion: 2.1 time: 0.236827 Nov 27 02:06:13 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 320/967] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:06:13 2023] GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3 => generated 1712 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: a3be4e2a-a586-45fd-b032-db434ecf6d4a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:18 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:18 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:18 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-2cddd15b-597c-49a9-8593-7b165ce9e91d tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/970ec924-cbd5-4aca-bbb6-e5543b956274" status: 200 len: 194 microversion: 2.1 time: 0.044036 Nov 27 02:06:18 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 321/968] 10.0.0.210 () {62 vars in 1490 bytes} [Mon Nov 27 02:06:18 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/970ec924-cbd5-4aca-bbb6-e5543b956274 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:18 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027d765937b430d9fbcdbc44f7dede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c187845e2645e3bcf55d62c94ff431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:06:18 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-65e88ae3-7c4d-4354-b0fa-ef2f3204cdac tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a" status: 200 len: 1484 microversion: 2.1 time: 0.212901 Nov 27 02:06:18 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 328/969] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:06:18 2023] GET /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a => generated 1484 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:06:18 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lazy-loading 'services' on Instance uuid a968a24b-8cb4-4a5e-9d35-23615494eb73 {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:06:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7e772890-0e56-4dac-8fb2-19ebc5e71709 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/970ec924-cbd5-4aca-bbb6-e5543b956274" status: 202 len: 0 microversion: 2.1 time: 0.190659 Nov 27 02:06:18 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 321/970] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:06:18 2023] DELETE /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments/970ec924-cbd5-4aca-bbb6-e5543b956274 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 02:06:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-e4a0821d-ae5e-4a13-ae61-a0cc03623bf0 req-b9758227-49fe-47d9-b782-b5e2694db93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c298f9-6e41-482f-a459-025232d56ed3", "name": "network-vif-unplugged", "status": "completed", "tag": "4dd769f0-6581-4dc9-b3c0-d810e6f88690"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e4a0821d-ae5e-4a13-ae61-a0cc03623bf0 req-b9758227-49fe-47d9-b782-b5e2694db93c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e4a0821d-ae5e-4a13-ae61-a0cc03623bf0 req-b9758227-49fe-47d9-b782-b5e2694db93c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e4a0821d-ae5e-4a13-ae61-a0cc03623bf0 req-b9758227-49fe-47d9-b782-b5e2694db93c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e4a0821d-ae5e-4a13-ae61-a0cc03623bf0 req-b9758227-49fe-47d9-b782-b5e2694db93c service nova] Creating event network-vif-unplugged:4dd769f0-6581-4dc9-b3c0-d810e6f88690 for instance e1c298f9-6e41-482f-a459-025232d56ed3 on user Nov 27 02:06:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-e4a0821d-ae5e-4a13-ae61-a0cc03623bf0 req-b9758227-49fe-47d9-b782-b5e2694db93c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109143 Nov 27 02:06:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 322/971] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:36 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:36 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:36 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-19014d40-b28b-43fc-8ff3-a8c5a4aaddb8 req-046a8c72-a3ab-4dc9-b252-9add1a598733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c298f9-6e41-482f-a459-025232d56ed3", "name": "network-vif-deleted", "tag": "4dd769f0-6581-4dc9-b3c0-d810e6f88690"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:36 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-19014d40-b28b-43fc-8ff3-a8c5a4aaddb8 req-046a8c72-a3ab-4dc9-b252-9add1a598733 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:36 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-19014d40-b28b-43fc-8ff3-a8c5a4aaddb8 req-046a8c72-a3ab-4dc9-b252-9add1a598733 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:36 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-19014d40-b28b-43fc-8ff3-a8c5a4aaddb8 req-046a8c72-a3ab-4dc9-b252-9add1a598733 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:36 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-19014d40-b28b-43fc-8ff3-a8c5a4aaddb8 req-046a8c72-a3ab-4dc9-b252-9add1a598733 service nova] Creating event network-vif-deleted:4dd769f0-6581-4dc9-b3c0-d810e6f88690 for instance e1c298f9-6e41-482f-a459-025232d56ed3 on user Nov 27 02:06:36 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-19014d40-b28b-43fc-8ff3-a8c5a4aaddb8 req-046a8c72-a3ab-4dc9-b252-9add1a598733 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097444 Nov 27 02:06:36 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 329/972] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:37 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:37 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:06:37 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-c4eed5b7-386a-4b8d-a95e-f20f81e91bf9 req-d4328b49-f9f8-4bf4-bac6-2fa6b34a4649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c298f9-6e41-482f-a459-025232d56ed3", "name": "network-vif-plugged", "status": "completed", "tag": "4dd769f0-6581-4dc9-b3c0-d810e6f88690"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c4eed5b7-386a-4b8d-a95e-f20f81e91bf9 req-d4328b49-f9f8-4bf4-bac6-2fa6b34a4649 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c4eed5b7-386a-4b8d-a95e-f20f81e91bf9 req-d4328b49-f9f8-4bf4-bac6-2fa6b34a4649 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c4eed5b7-386a-4b8d-a95e-f20f81e91bf9 req-d4328b49-f9f8-4bf4-bac6-2fa6b34a4649 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:37 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c4eed5b7-386a-4b8d-a95e-f20f81e91bf9 req-d4328b49-f9f8-4bf4-bac6-2fa6b34a4649 service nova] Creating event network-vif-plugged:4dd769f0-6581-4dc9-b3c0-d810e6f88690 for instance e1c298f9-6e41-482f-a459-025232d56ed3 on user Nov 27 02:06:37 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-c4eed5b7-386a-4b8d-a95e-f20f81e91bf9 req-d4328b49-f9f8-4bf4-bac6-2fa6b34a4649 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036162 Nov 27 02:06:37 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 322/973] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-233a0b38-b948-497d-8081-87df4f2377df tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040933 Nov 27 02:06:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 323/974] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:06:41 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5434e5f4-2b63-4a02-93fc-282e1b01d38c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042580 Nov 27 02:06:41 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 330/975] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:06:41 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:06:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b57a2da9-b9b6-4567-87cc-c71d7d02e2ea tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73" status: 204 len: 0 microversion: 2.1 time: 0.110961 Nov 27 02:06:41 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 323/976] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:06:41 2023] DELETE /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98756aa16183475ca8113257bb08da2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f58fef2b9a44c91b1990c8b5b07212c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:06:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a622f8a1-0803-4ac2-8fb1-4987154a9a03 tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73" status: 200 len: 1657 microversion: 2.1 time: 0.202827 Nov 27 02:06:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 324/977] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:06:41 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73 => generated 1657 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-0486f978-0e25-4c39-87f1-234931f17e8a req-b7fef61c-64cd-41da-bb0c-b51d39d50d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a968a24b-8cb4-4a5e-9d35-23615494eb73", "name": "network-vif-unplugged", "status": "completed", "tag": "4a7b08d0-0b17-4722-b9e2-cef978e3ed18"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0486f978-0e25-4c39-87f1-234931f17e8a req-b7fef61c-64cd-41da-bb0c-b51d39d50d12 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0486f978-0e25-4c39-87f1-234931f17e8a req-b7fef61c-64cd-41da-bb0c-b51d39d50d12 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0486f978-0e25-4c39-87f1-234931f17e8a req-b7fef61c-64cd-41da-bb0c-b51d39d50d12 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-0486f978-0e25-4c39-87f1-234931f17e8a req-b7fef61c-64cd-41da-bb0c-b51d39d50d12 service nova] Creating event network-vif-unplugged:4a7b08d0-0b17-4722-b9e2-cef978e3ed18 for instance a968a24b-8cb4-4a5e-9d35-23615494eb73 on user Nov 27 02:06:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-0486f978-0e25-4c39-87f1-234931f17e8a req-b7fef61c-64cd-41da-bb0c-b51d39d50d12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031891 Nov 27 02:06:41 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 331/978] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:43 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-ed71c0f4-9447-44b3-9daa-5ce0f01016c4 req-6076b3df-e96f-4eb6-a439-aceeeb5a69c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a968a24b-8cb4-4a5e-9d35-23615494eb73", "name": "network-vif-plugged", "status": "completed", "tag": "4a7b08d0-0b17-4722-b9e2-cef978e3ed18"}, {"server_uuid": "a968a24b-8cb4-4a5e-9d35-23615494eb73", "name": "network-vif-deleted", "tag": "4a7b08d0-0b17-4722-b9e2-cef978e3ed18"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ed71c0f4-9447-44b3-9daa-5ce0f01016c4 req-6076b3df-e96f-4eb6-a439-aceeeb5a69c4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ed71c0f4-9447-44b3-9daa-5ce0f01016c4 req-6076b3df-e96f-4eb6-a439-aceeeb5a69c4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ed71c0f4-9447-44b3-9daa-5ce0f01016c4 req-6076b3df-e96f-4eb6-a439-aceeeb5a69c4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-ed71c0f4-9447-44b3-9daa-5ce0f01016c4 req-6076b3df-e96f-4eb6-a439-aceeeb5a69c4 service nova] Creating event network-vif-plugged:4a7b08d0-0b17-4722-b9e2-cef978e3ed18 for instance a968a24b-8cb4-4a5e-9d35-23615494eb73 on user Nov 27 02:06:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-ed71c0f4-9447-44b3-9daa-5ce0f01016c4 req-6076b3df-e96f-4eb6-a439-aceeeb5a69c4 service nova] Creating event network-vif-deleted:4a7b08d0-0b17-4722-b9e2-cef978e3ed18 for instance a968a24b-8cb4-4a5e-9d35-23615494eb73 on user Nov 27 02:06:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-ed71c0f4-9447-44b3-9daa-5ce0f01016c4 req-6076b3df-e96f-4eb6-a439-aceeeb5a69c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033065 Nov 27 02:06:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 324/979] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-eb9ae3c8-6fb1-461d-a60b-903df18857a0 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042823 Nov 27 02:06:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 325/980] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:06:49 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:49 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:06:49 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8b79ef3e-1658-4b41-878d-cd4ae1ad591c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 204 len: 0 microversion: 2.87 time: 0.118937 Nov 27 02:06:49 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 332/981] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 02:06:49 2023] DELETE /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:06:49 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:06:49 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a505ebbe-f177-4e5b-847c-7fb1c10c7669 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 200 len: 1773 microversion: 2.87 time: 0.234898 Nov 27 02:06:49 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 325/982] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:06:49 2023] GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 1773 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-b204b37d-5444-4c55-978f-dfa3806cdb3c req-20ec1bdc-ffbe-425e-b44d-ef40469f725e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-unplugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b204b37d-5444-4c55-978f-dfa3806cdb3c req-20ec1bdc-ffbe-425e-b44d-ef40469f725e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b204b37d-5444-4c55-978f-dfa3806cdb3c req-20ec1bdc-ffbe-425e-b44d-ef40469f725e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:49 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b204b37d-5444-4c55-978f-dfa3806cdb3c req-20ec1bdc-ffbe-425e-b44d-ef40469f725e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b204b37d-5444-4c55-978f-dfa3806cdb3c req-20ec1bdc-ffbe-425e-b44d-ef40469f725e service nova] Creating event network-vif-unplugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:06:49 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-b204b37d-5444-4c55-978f-dfa3806cdb3c req-20ec1bdc-ffbe-425e-b44d-ef40469f725e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032927 Nov 27 02:06:49 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 326/983] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:51 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-8b29943d-25cb-4f97-b409-240fc3dccbe3 req-8dbd5fb6-9a01-4b70-b698-52dd376eb6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-deleted", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8b29943d-25cb-4f97-b409-240fc3dccbe3 req-8dbd5fb6-9a01-4b70-b698-52dd376eb6d3 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8b29943d-25cb-4f97-b409-240fc3dccbe3 req-8dbd5fb6-9a01-4b70-b698-52dd376eb6d3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:51 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8b29943d-25cb-4f97-b409-240fc3dccbe3 req-8dbd5fb6-9a01-4b70-b698-52dd376eb6d3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:51 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-8b29943d-25cb-4f97-b409-240fc3dccbe3 req-8dbd5fb6-9a01-4b70-b698-52dd376eb6d3 service nova] Creating event network-vif-deleted:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:06:51 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-8b29943d-25cb-4f97-b409-240fc3dccbe3 req-8dbd5fb6-9a01-4b70-b698-52dd376eb6d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048408 Nov 27 02:06:51 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 333/984] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:51 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-unplugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}, {"server_uuid": "22eebc55-69ce-4552-9a26-fc26a7d9d40f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce3a4a-dbed-4b67-b8e4-19221c7e59ea"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:51 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:06:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:06:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:06:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Creating event network-vif-unplugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:06:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] Creating event network-vif-plugged:94ce3a4a-dbed-4b67-b8e4-19221c7e59ea for instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f on user Nov 27 02:06:51 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-fa9094c2-4be5-4fe2-b503-9536f4a2c66c req-86350b37-b304-452b-b65d-cbe996e8b0a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034222 Nov 27 02:06:51 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 326/985] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fca133b3-da12-4c2a-8843-5cc8f4666e2d"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:52 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-becd1242-a817-4506-bea5-f0b0a02c2aeb tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260102 Nov 27 02:06:52 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 327/986] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:06:52 2023] POST /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:06:59 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:06:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-af9b53bd-cb2a-4fb3-ab29-6406489f05a1 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.147660 Nov 27 02:06:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 334/987] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:06:59 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-interface => generated 283 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:06:59 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-18f9562b-babd-4a1f-9722-2a435010b7a2 req-5def49f5-4cd4-47d5-9f4c-be96f5b17692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52edffde-5d81-4b3e-9e14-6558bec163f9", "tag": "64e8b7c0-922f-4a3f-8e35-8f6657a38de6"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:06:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-18f9562b-babd-4a1f-9722-2a435010b7a2 req-5def49f5-4cd4-47d5-9f4c-be96f5b17692 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:06:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-18f9562b-babd-4a1f-9722-2a435010b7a2 req-5def49f5-4cd4-47d5-9f4c-be96f5b17692 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:06:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-18f9562b-babd-4a1f-9722-2a435010b7a2 req-5def49f5-4cd4-47d5-9f4c-be96f5b17692 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:06:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-18f9562b-babd-4a1f-9722-2a435010b7a2 req-5def49f5-4cd4-47d5-9f4c-be96f5b17692 service nova] Creating event network-changed:64e8b7c0-922f-4a3f-8e35-8f6657a38de6 for instance 52edffde-5d81-4b3e-9e14-6558bec163f9 on user Nov 27 02:06:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-18f9562b-babd-4a1f-9722-2a435010b7a2 req-5def49f5-4cd4-47d5-9f4c-be96f5b17692 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032123 Nov 27 02:06:59 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 327/988] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:06:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:00 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-209a4cb6-8516-4e65-a79d-a5ffcb7ce160 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/ips" status: 200 len: 108 microversion: 2.1 time: 0.037174 Nov 27 02:07:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 328/989] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:07:00 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:02 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lazy-loading 'services' on Instance uuid 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:07:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-ba29fedc-652c-493a-ade2-fceabd45239e tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments/fca133b3-da12-4c2a-8843-5cc8f4666e2d" status: 202 len: 0 microversion: 2.1 time: 0.174486 Nov 27 02:07:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 335/990] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:07:02 2023] DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments/fca133b3-da12-4c2a-8843-5cc8f4666e2d => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:07:02 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:02 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5837e980-c1db-4982-8b9e-bd77bed896ad tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047398 Nov 27 02:07:02 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 328/991] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:07:02 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6124d788-56f3-4432-9ded-769e9f5b357c"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3fb5f344-d4d4-490c-a6ca-4b73ff9fc6b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279130 Nov 27 02:07:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 329/992] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:07:02 2023] POST /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: e1c298f9-6e41-482f-a459-025232d56ed3] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] HTTP exception thrown: Instance e1c298f9-6e41-482f-a459-025232d56ed3 could not be found. Nov 27 02:07:03 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Returning 404 to user: Instance e1c298f9-6e41-482f-a459-025232d56ed3 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:07:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-04520c72-4861-4bde-ba67-ef25dafd9ff8 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3" status: 404 len: 111 microversion: 2.1 time: 0.028041 Nov 27 02:07:03 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 336/993] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:07:03 2023] GET /compute/v2.1/servers/e1c298f9-6e41-482f-a459-025232d56ed3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:07:03 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c5f6cecd-965a-47ad-8fec-d2a18e8bbd63 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '.version_select at 0x7f364afcd900>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c5f6cecd-965a-47ad-8fec-d2a18e8bbd63 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551362897" status: 202 len: 0 microversion: 2.1 time: 0.025302 Nov 27 02:07:03 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 329/994] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 02:07:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551362897 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6124d788-56f3-4432-9ded-769e9f5b357c"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Invalid volume: volume 6124d788-56f3-4432-9ded-769e9f5b357c is already attached to instances: 52edffde-5d81-4b3e-9e14-6558bec163f9 Nov 27 02:07:11 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 400 to user: Invalid volume: volume 6124d788-56f3-4432-9ded-769e9f5b357c is already attached to instances: 52edffde-5d81-4b3e-9e14-6558bec163f9 {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:07:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-5e865489-949c-4b31-9f56-969d6ac9c6c0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101527 Nov 27 02:07:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 330/995] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:07:11 2023] POST /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:11 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lazy-loading 'services' on Instance uuid 52edffde-5d81-4b3e-9e14-6558bec163f9 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:07:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0f4c41fa-9345-4600-b25e-f626feff67fe tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments/6124d788-56f3-4432-9ded-769e9f5b357c" status: 202 len: 0 microversion: 2.1 time: 0.168634 Nov 27 02:07:12 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 337/996] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:07:11 2023] DELETE /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments/6124d788-56f3-4432-9ded-769e9f5b357c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:07:12 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:12 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:12 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e9d60f6b-3239-4500-849f-aaa337498987 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054531 Nov 27 02:07:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 330/997] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:07:12 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:17 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c282ff0d-49d1-4a05-a182-65111c833499 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Action: 'create', calling method: .version_select at 0x7f364b2c3010>, body: {"keypair": {"name": "tempest-keypair-1187558695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSmiq1+sk65Km2/qDoWLKpTUc4lWCZ0Gl7Fmkzt33UN8sNo5rSMYuKKhKpqJTPsp0fePlA08NIjJJKNpqkfVxrZHG07zwBVvfBkLtDYMRhNPerykp7+i2PPC5IyfmP6tQ=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:17 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-c282ff0d-49d1-4a05-a182-65111c833499 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Getting quotas for project bd748cef1b564d42affdddac5e7e6d82. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:07:17 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-c282ff0d-49d1-4a05-a182-65111c833499 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Getting quotas for user 4874ba5054e843be8abb960e24d90c61 and project bd748cef1b564d42affdddac5e7e6d82. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:07:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c282ff0d-49d1-4a05-a182-65111c833499 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048759 Nov 27 02:07:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 331/998] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:07:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-231949093", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "3039617e-0641-46ad-b771-dc68d60f8668"}], "security_groups": [{"name": "tempest-securitygroup--2141639065"}], "key_name": "tempest-keypair-1187558695", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: a3be4e2a-a586-45fd-b032-db434ecf6d4a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:18 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] validate_networks() for [('3039617e-0641-46ad-b771-dc68d60f8668', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:18 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: a3be4e2a-a586-45fd-b032-db434ecf6d4a] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:07:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c2483ad8-6013-4a09-9c0a-425de808924c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a" status: 204 len: 0 microversion: 2.1 time: 0.140424 Nov 27 02:07:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 331/999] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:07:18 2023] DELETE /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: a3be4e2a-a586-45fd-b032-db434ecf6d4a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027d765937b430d9fbcdbc44f7dede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c187845e2645e3bcf55d62c94ff431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:07:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c5731e91-377d-4357-921b-0e1bd7eaedd2 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a" status: 200 len: 1490 microversion: 2.1 time: 0.599137 Nov 27 02:07:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 332/1000] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:07:19 2023] GET /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a => generated 1490 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Getting quotas for project bd748cef1b564d42affdddac5e7e6d82. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Getting quotas for user 4874ba5054e843be8abb960e24d90c61 and project bd748cef1b564d42affdddac5e7e6d82. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:07:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-efab7726-6560-4234-a755-200b444bc8a1 req-817de8cf-dc66-419f-8d22-489b6b6102bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3be4e2a-a586-45fd-b032-db434ecf6d4a", "name": "network-vif-unplugged", "status": "completed", "tag": "3dfdd2f7-5d38-486c-a0db-cc3e125ed498"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:19 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:07:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-efab7726-6560-4234-a755-200b444bc8a1 req-817de8cf-dc66-419f-8d22-489b6b6102bf service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-efab7726-6560-4234-a755-200b444bc8a1 req-817de8cf-dc66-419f-8d22-489b6b6102bf service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-efab7726-6560-4234-a755-200b444bc8a1 req-817de8cf-dc66-419f-8d22-489b6b6102bf service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-efab7726-6560-4234-a755-200b444bc8a1 req-817de8cf-dc66-419f-8d22-489b6b6102bf service nova] Creating event network-vif-unplugged:3dfdd2f7-5d38-486c-a0db-cc3e125ed498 for instance a3be4e2a-a586-45fd-b032-db434ecf6d4a on user Nov 27 02:07:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-efab7726-6560-4234-a755-200b444bc8a1 req-817de8cf-dc66-419f-8d22-489b6b6102bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033926 Nov 27 02:07:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 332/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3aeb939f-a42d-4774-9d5c-79467fc3335e tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.043904 Nov 27 02:07:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 338/1002] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:07:18 2023] POST /compute/v2.1/servers => generated 404 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-fec804ed-943f-455e-9afa-9a14711db366 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-fec804ed-943f-455e-9afa-9a14711db366 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:19 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-fec804ed-943f-455e-9afa-9a14711db366 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874ba5054e843be8abb960e24d90c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd748cef1b564d42affdddac5e7e6d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:07:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-fec804ed-943f-455e-9afa-9a14711db366 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b" status: 200 len: 1234 microversion: 2.1 time: 0.090293 Nov 27 02:07:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 333/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:07:19 2023] GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:07:20 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-951bbfd6-4b68-40c5-9ae2-7f4917da61e0 req-ede8ee1e-6e80-4597-a773-c1cb63bc38cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3be4e2a-a586-45fd-b032-db434ecf6d4a", "name": "network-vif-deleted", "tag": "3dfdd2f7-5d38-486c-a0db-cc3e125ed498"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-951bbfd6-4b68-40c5-9ae2-7f4917da61e0 req-ede8ee1e-6e80-4597-a773-c1cb63bc38cb service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-951bbfd6-4b68-40c5-9ae2-7f4917da61e0 req-ede8ee1e-6e80-4597-a773-c1cb63bc38cb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:20 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-951bbfd6-4b68-40c5-9ae2-7f4917da61e0 req-ede8ee1e-6e80-4597-a773-c1cb63bc38cb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-951bbfd6-4b68-40c5-9ae2-7f4917da61e0 req-ede8ee1e-6e80-4597-a773-c1cb63bc38cb service nova] Creating event network-vif-deleted:3dfdd2f7-5d38-486c-a0db-cc3e125ed498 for instance a3be4e2a-a586-45fd-b032-db434ecf6d4a on user Nov 27 02:07:20 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-951bbfd6-4b68-40c5-9ae2-7f4917da61e0 req-ede8ee1e-6e80-4597-a773-c1cb63bc38cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034445 Nov 27 02:07:20 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 333/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-38174b9a-c4ff-4bc0-8f00-4f95a7afedad req-e47f0a31-a2b4-4d6b-bb41-39b651ac6c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3be4e2a-a586-45fd-b032-db434ecf6d4a", "name": "network-vif-plugged", "status": "completed", "tag": "3dfdd2f7-5d38-486c-a0db-cc3e125ed498"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-38174b9a-c4ff-4bc0-8f00-4f95a7afedad req-e47f0a31-a2b4-4d6b-bb41-39b651ac6c91 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-38174b9a-c4ff-4bc0-8f00-4f95a7afedad req-e47f0a31-a2b4-4d6b-bb41-39b651ac6c91 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-38174b9a-c4ff-4bc0-8f00-4f95a7afedad req-e47f0a31-a2b4-4d6b-bb41-39b651ac6c91 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-38174b9a-c4ff-4bc0-8f00-4f95a7afedad req-e47f0a31-a2b4-4d6b-bb41-39b651ac6c91 service nova] Creating event network-vif-plugged:3dfdd2f7-5d38-486c-a0db-cc3e125ed498 for instance a3be4e2a-a586-45fd-b032-db434ecf6d4a on user Nov 27 02:07:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-38174b9a-c4ff-4bc0-8f00-4f95a7afedad req-e47f0a31-a2b4-4d6b-bb41-39b651ac6c91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028828 Nov 27 02:07:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 339/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:22 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-3b8c610b-d9d9-42e5-8368-845c4df690a0 req-1b308559-566d-4de8-84ac-7c71ee34b44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47255513-0bc4-4344-ba45-2798e920c44b", "tag": "1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3b8c610b-d9d9-42e5-8368-845c4df690a0 req-1b308559-566d-4de8-84ac-7c71ee34b44c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3b8c610b-d9d9-42e5-8368-845c4df690a0 req-1b308559-566d-4de8-84ac-7c71ee34b44c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:22 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-3b8c610b-d9d9-42e5-8368-845c4df690a0 req-1b308559-566d-4de8-84ac-7c71ee34b44c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-3b8c610b-d9d9-42e5-8368-845c4df690a0 req-1b308559-566d-4de8-84ac-7c71ee34b44c service nova] Creating event network-changed:1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600 for instance 47255513-0bc4-4344-ba45-2798e920c44b on user Nov 27 02:07:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-3b8c610b-d9d9-42e5-8368-845c4df690a0 req-1b308559-566d-4de8-84ac-7c71ee34b44c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032012 Nov 27 02:07:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 334/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:24 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-061c3fad-80bf-42e7-82a8-b7fcc5afb59a req-9ebd4f9a-7c7d-470c-88d9-3a7c7295c91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47255513-0bc4-4344-ba45-2798e920c44b", "name": "network-vif-plugged", "status": "completed", "tag": "1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-061c3fad-80bf-42e7-82a8-b7fcc5afb59a req-9ebd4f9a-7c7d-470c-88d9-3a7c7295c91a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-061c3fad-80bf-42e7-82a8-b7fcc5afb59a req-9ebd4f9a-7c7d-470c-88d9-3a7c7295c91a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-061c3fad-80bf-42e7-82a8-b7fcc5afb59a req-9ebd4f9a-7c7d-470c-88d9-3a7c7295c91a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-061c3fad-80bf-42e7-82a8-b7fcc5afb59a req-9ebd4f9a-7c7d-470c-88d9-3a7c7295c91a service nova] Creating event network-vif-plugged:1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600 for instance 47255513-0bc4-4344-ba45-2798e920c44b on user Nov 27 02:07:24 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-061c3fad-80bf-42e7-82a8-b7fcc5afb59a req-9ebd4f9a-7c7d-470c-88d9-3a7c7295c91a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045449 Nov 27 02:07:24 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 334/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-a8969ed5-6bea-446c-b0bd-cd0ad424747b req-b8d0199d-dc00-463a-8a6e-96e084ba7ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47255513-0bc4-4344-ba45-2798e920c44b", "name": "network-vif-plugged", "status": "completed", "tag": "1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a8969ed5-6bea-446c-b0bd-cd0ad424747b req-b8d0199d-dc00-463a-8a6e-96e084ba7ed6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a8969ed5-6bea-446c-b0bd-cd0ad424747b req-b8d0199d-dc00-463a-8a6e-96e084ba7ed6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a8969ed5-6bea-446c-b0bd-cd0ad424747b req-b8d0199d-dc00-463a-8a6e-96e084ba7ed6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-a8969ed5-6bea-446c-b0bd-cd0ad424747b req-b8d0199d-dc00-463a-8a6e-96e084ba7ed6 service nova] Creating event network-vif-plugged:1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600 for instance 47255513-0bc4-4344-ba45-2798e920c44b on user Nov 27 02:07:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-a8969ed5-6bea-446c-b0bd-cd0ad424747b req-b8d0199d-dc00-463a-8a6e-96e084ba7ed6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027884 Nov 27 02:07:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 340/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] HTTP exception thrown: Instance a968a24b-8cb4-4a5e-9d35-23615494eb73 could not be found. Nov 27 02:07:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Returning 404 to user: Instance a968a24b-8cb4-4a5e-9d35-23615494eb73 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:07:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6402d100-64bd-4f16-a039-3ad90182398e tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73" status: 404 len: 111 microversion: 2.1 time: 0.030462 Nov 27 02:07:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 335/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:07:31 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:07:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c7e9ae44-ab8f-4bbb-b9b7-a3c02986e2cf tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '.version_select at 0x7f364b0e31c0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c7e9ae44-ab8f-4bbb-b9b7-a3c02986e2cf tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-844773472" status: 202 len: 0 microversion: 2.1 time: 0.028628 Nov 27 02:07:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 335/1010] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 02:07:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-844773472 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:38 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] HTTP exception thrown: Instance a968a24b-8cb4-4a5e-9d35-23615494eb73 could not be found. Nov 27 02:07:38 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Returning 404 to user: Instance a968a24b-8cb4-4a5e-9d35-23615494eb73 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:07:38 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-37558264-d287-4b17-94d9-5734af493ead tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73" status: 404 len: 111 microversion: 2.1 time: 0.046372 Nov 27 02:07:38 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 341/1011] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:07:38 2023] DELETE /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: a968a24b-8cb4-4a5e-9d35-23615494eb73] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] HTTP exception thrown: Instance a968a24b-8cb4-4a5e-9d35-23615494eb73 could not be found. Nov 27 02:07:38 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Returning 404 to user: Instance a968a24b-8cb4-4a5e-9d35-23615494eb73 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:07:38 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d3366dd4-adb4-4d46-b05c-6784b4e3699f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73" status: 404 len: 111 microversion: 2.1 time: 0.036504 Nov 27 02:07:38 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:07:38 2023] GET /compute/v2.1/servers/a968a24b-8cb4-4a5e-9d35-23615494eb73 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 22eebc55-69ce-4552-9a26-fc26a7d9d40f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] HTTP exception thrown: Instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f could not be found. Nov 27 02:07:39 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Returning 404 to user: Instance 22eebc55-69ce-4552-9a26-fc26a7d9d40f could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:07:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-34199e28-7b20-46d3-88b0-201c2f0a930a tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f" status: 404 len: 111 microversion: 2.87 time: 0.086609 Nov 27 02:07:39 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 336/1013] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:07:39 2023] GET /compute/v2.1/servers/22eebc55-69ce-4552-9a26-fc26a7d9d40f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:40 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:07:40 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4291182e-3708-4829-8455-5981f28a5e07 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c" status: 204 len: 0 microversion: 2.87 time: 0.113386 Nov 27 02:07:40 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 342/1014] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 02:07:40 2023] DELETE /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:40 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-2c10977d-f1aa-4a88-bdbd-319ae5596186 req-071aeb24-416f-4732-9eda-0a57c6e78d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fa880a-3dc3-4455-9d4b-967c16beed5c", "name": "network-vif-unplugged", "status": "completed", "tag": "3a963bef-d949-42df-a116-7049ffc392a8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:07:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2c10977d-f1aa-4a88-bdbd-319ae5596186 req-071aeb24-416f-4732-9eda-0a57c6e78d8f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2c10977d-f1aa-4a88-bdbd-319ae5596186 req-071aeb24-416f-4732-9eda-0a57c6e78d8f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:40 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2c10977d-f1aa-4a88-bdbd-319ae5596186 req-071aeb24-416f-4732-9eda-0a57c6e78d8f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:07:40 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:07:40 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-1b776b6b-cc28-49b0-8961-09679185c515 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c" status: 200 len: 1695 microversion: 2.87 time: 0.341019 Nov 27 02:07:40 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 337/1015] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:07:40 2023] GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c => generated 1695 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:07:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-2c10977d-f1aa-4a88-bdbd-319ae5596186 req-071aeb24-416f-4732-9eda-0a57c6e78d8f service nova] Creating event network-vif-unplugged:3a963bef-d949-42df-a116-7049ffc392a8 for instance 11fa880a-3dc3-4455-9d4b-967c16beed5c on user Nov 27 02:07:40 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-2c10977d-f1aa-4a88-bdbd-319ae5596186 req-071aeb24-416f-4732-9eda-0a57c6e78d8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037198 Nov 27 02:07:40 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 337/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:41 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-0b5346c0-142d-4366-9fb3-0d14b880baf7 req-c1bf776b-6d18-4b0d-bad3-2fbea3488986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fa880a-3dc3-4455-9d4b-967c16beed5c", "name": "network-vif-deleted", "tag": "3a963bef-d949-42df-a116-7049ffc392a8"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0b5346c0-142d-4366-9fb3-0d14b880baf7 req-c1bf776b-6d18-4b0d-bad3-2fbea3488986 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0b5346c0-142d-4366-9fb3-0d14b880baf7 req-c1bf776b-6d18-4b0d-bad3-2fbea3488986 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:41 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-0b5346c0-142d-4366-9fb3-0d14b880baf7 req-c1bf776b-6d18-4b0d-bad3-2fbea3488986 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-0b5346c0-142d-4366-9fb3-0d14b880baf7 req-c1bf776b-6d18-4b0d-bad3-2fbea3488986 service nova] Creating event network-vif-deleted:3a963bef-d949-42df-a116-7049ffc392a8 for instance 11fa880a-3dc3-4455-9d4b-967c16beed5c on user Nov 27 02:07:41 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-0b5346c0-142d-4366-9fb3-0d14b880baf7 req-c1bf776b-6d18-4b0d-bad3-2fbea3488986 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036532 Nov 27 02:07:41 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 343/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] HTTP exception thrown: Instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc could not be found. Nov 27 02:07:42 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Returning 404 to user: Instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:07:42 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0a68de08-28cf-4f29-adfd-df5605a96b6c tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 404 len: 111 microversion: 2.1 time: 0.030187 Nov 27 02:07:42 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 338/1018] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:07:42 2023] DELETE /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] [instance: 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] HTTP exception thrown: Instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc could not be found. Nov 27 02:07:42 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] Returning 404 to user: Instance 53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:07:42 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c3a2b1b4-0cbe-457b-a5fd-b6bd8131506f tempest-AttachVolumeTestJSON-107900000 tempest-AttachVolumeTestJSON-107900000-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc" status: 404 len: 111 microversion: 2.1 time: 0.029362 Nov 27 02:07:42 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 338/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:07:42 2023] GET /compute/v2.1/servers/53d1a8a0-44a3-4600-a31a-7e75c4d4a5bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:07:42 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-25a9e363-6910-49d9-98fb-3d1be56b0d12 req-34361ae7-3730-4c48-b49f-bf671caa271c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fa880a-3dc3-4455-9d4b-967c16beed5c", "name": "network-vif-plugged", "status": "completed", "tag": "3a963bef-d949-42df-a116-7049ffc392a8"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-25a9e363-6910-49d9-98fb-3d1be56b0d12 req-34361ae7-3730-4c48-b49f-bf671caa271c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-25a9e363-6910-49d9-98fb-3d1be56b0d12 req-34361ae7-3730-4c48-b49f-bf671caa271c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-25a9e363-6910-49d9-98fb-3d1be56b0d12 req-34361ae7-3730-4c48-b49f-bf671caa271c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-25a9e363-6910-49d9-98fb-3d1be56b0d12 req-34361ae7-3730-4c48-b49f-bf671caa271c service nova] Creating event network-vif-plugged:3a963bef-d949-42df-a116-7049ffc392a8 for instance 11fa880a-3dc3-4455-9d4b-967c16beed5c on user Nov 27 02:07:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-25a9e363-6910-49d9-98fb-3d1be56b0d12 req-34361ae7-3730-4c48-b49f-bf671caa271c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034154 Nov 27 02:07:42 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 344/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=7 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=9 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9883ed3a-f596-4b18-80b4-035c01deca6c tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148274 Nov 27 02:07:52 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 339/1021] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:07:52 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b734d7bd-95d8-4a03-9c12-dedb55f88a72"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=5 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:07:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:07:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4d5529df-e1e3-49a5-9951-6b81dff59f2a tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304586 Nov 27 02:07:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 339/1022] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:07:55 2023] POST /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-1098ae27-e20f-4c40-92d9-875e411fe39e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053868 Nov 27 02:08:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 345/1023] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:08:02 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:08:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-452e70e4-1e9b-4de2-b8d3-ab8a1220e93c tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9" status: 204 len: 0 microversion: 2.1 time: 0.117110 Nov 27 02:08:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 340/1024] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:08:02 2023] DELETE /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-a4ef6487-7be6-4321-920a-da4f08ac8386 req-6fdcacfd-ab0d-4444-962f-34d708bac16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52edffde-5d81-4b3e-9e14-6558bec163f9", "name": "network-vif-unplugged", "status": "completed", "tag": "64e8b7c0-922f-4a3f-8e35-8f6657a38de6"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:02 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:08:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-edbb8b3f-afa8-42f0-ac7c-d2969a48e714 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9" status: 200 len: 1668 microversion: 2.1 time: 0.252578 Nov 27 02:08:02 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 340/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:08:02 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9 => generated 1668 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a4ef6487-7be6-4321-920a-da4f08ac8386 req-6fdcacfd-ab0d-4444-962f-34d708bac16e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a4ef6487-7be6-4321-920a-da4f08ac8386 req-6fdcacfd-ab0d-4444-962f-34d708bac16e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-a4ef6487-7be6-4321-920a-da4f08ac8386 req-6fdcacfd-ab0d-4444-962f-34d708bac16e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-a4ef6487-7be6-4321-920a-da4f08ac8386 req-6fdcacfd-ab0d-4444-962f-34d708bac16e service nova] Creating event network-vif-unplugged:64e8b7c0-922f-4a3f-8e35-8f6657a38de6 for instance 52edffde-5d81-4b3e-9e14-6558bec163f9 on user Nov 27 02:08:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-a4ef6487-7be6-4321-920a-da4f08ac8386 req-6fdcacfd-ab0d-4444-962f-34d708bac16e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039245 Nov 27 02:08:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 346/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:04 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-be45ee05-2156-4526-8c86-cdaeb9b6b9ff req-f0f32466-1103-4e41-8737-a76d0a0ee662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52edffde-5d81-4b3e-9e14-6558bec163f9", "name": "network-vif-deleted", "tag": "64e8b7c0-922f-4a3f-8e35-8f6657a38de6"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-be45ee05-2156-4526-8c86-cdaeb9b6b9ff req-f0f32466-1103-4e41-8737-a76d0a0ee662 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-be45ee05-2156-4526-8c86-cdaeb9b6b9ff req-f0f32466-1103-4e41-8737-a76d0a0ee662 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-be45ee05-2156-4526-8c86-cdaeb9b6b9ff req-f0f32466-1103-4e41-8737-a76d0a0ee662 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:04 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-be45ee05-2156-4526-8c86-cdaeb9b6b9ff req-f0f32466-1103-4e41-8737-a76d0a0ee662 service nova] Creating event network-vif-deleted:64e8b7c0-922f-4a3f-8e35-8f6657a38de6 for instance 52edffde-5d81-4b3e-9e14-6558bec163f9 on user Nov 27 02:08:04 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-be45ee05-2156-4526-8c86-cdaeb9b6b9ff req-f0f32466-1103-4e41-8737-a76d0a0ee662 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031620 Nov 27 02:08:04 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 341/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:04 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-477793fd-1fe1-4e77-ad83-19e9286a9389 req-ced47697-a436-476e-9973-d8430c42181d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52edffde-5d81-4b3e-9e14-6558bec163f9", "name": "network-vif-plugged", "status": "completed", "tag": "64e8b7c0-922f-4a3f-8e35-8f6657a38de6"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-477793fd-1fe1-4e77-ad83-19e9286a9389 req-ced47697-a436-476e-9973-d8430c42181d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-477793fd-1fe1-4e77-ad83-19e9286a9389 req-ced47697-a436-476e-9973-d8430c42181d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-477793fd-1fe1-4e77-ad83-19e9286a9389 req-ced47697-a436-476e-9973-d8430c42181d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:04 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-477793fd-1fe1-4e77-ad83-19e9286a9389 req-ced47697-a436-476e-9973-d8430c42181d service nova] Creating event network-vif-plugged:64e8b7c0-922f-4a3f-8e35-8f6657a38de6 for instance 52edffde-5d81-4b3e-9e14-6558bec163f9 on user Nov 27 02:08:04 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-477793fd-1fe1-4e77-ad83-19e9286a9389 req-ced47697-a436-476e-9973-d8430c42181d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036132 Nov 27 02:08:04 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 341/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:07 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:07 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:08 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lazy-loading 'services' on Instance uuid 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:08:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-28738eca-ef75-4ac0-9031-55c890db0d26 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments/b734d7bd-95d8-4a03-9c12-dedb55f88a72" status: 202 len: 0 microversion: 2.1 time: 0.157506 Nov 27 02:08:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 347/1029] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:08:07 2023] DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments/b734d7bd-95d8-4a03-9c12-dedb55f88a72 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:08:08 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:08 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:08 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:08 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a850df8c-b803-47d5-98ff-a8cb78d25ad8 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041699 Nov 27 02:08:08 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 342/1030] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:08:08 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: a3be4e2a-a586-45fd-b032-db434ecf6d4a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] HTTP exception thrown: Instance a3be4e2a-a586-45fd-b032-db434ecf6d4a could not be found. Nov 27 02:08:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Returning 404 to user: Instance a3be4e2a-a586-45fd-b032-db434ecf6d4a could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:08:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-2636ed09-916d-4f1a-b6d2-07acaf80fd9c tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a" status: 404 len: 111 microversion: 2.1 time: 0.031487 Nov 27 02:08:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 342/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:08:09 2023] GET /compute/v2.1/servers/a3be4e2a-a586-45fd-b032-db434ecf6d4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:08:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-478493346", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "c6ff7fc3-6536-49a3-aa44-67a01786a630"}]}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:09 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] validate_networks() for [('c6ff7fc3-6536-49a3-aa44-67a01786a630', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:10 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874ba5054e843be8abb960e24d90c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd748cef1b564d42affdddac5e7e6d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:08:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-b3c1b490-6e2f-4c2c-a4d5-6f786816fc82 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b" status: 200 len: 1543 microversion: 2.1 time: 0.318054 Nov 27 02:08:10 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 343/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:08:10 2023] GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b => generated 1543 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Getting quotas for project 76c187845e2645e3bcf55d62c94ff431. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Getting quotas for user 8027d765937b430d9fbcdbc44f7dede5 and project 76c187845e2645e3bcf55d62c94ff431. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:08:10 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: 59d54b1b-4275-4929-b1af-1b216b8971dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:08:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-f3a8093f-5ec4-43a1-b503-59b872ce3329 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.624851 Nov 27 02:08:10 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 348/1033] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:08:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:08:10 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5bbea246-9851-4c46-bbc8-58197d2a5846 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:10 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5bbea246-9851-4c46-bbc8-58197d2a5846 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: 59d54b1b-4275-4929-b1af-1b216b8971dd] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:10 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-5bbea246-9851-4c46-bbc8-58197d2a5846 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027d765937b430d9fbcdbc44f7dede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c187845e2645e3bcf55d62c94ff431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:08:10 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5bbea246-9851-4c46-bbc8-58197d2a5846 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd" status: 200 len: 1205 microversion: 2.1 time: 0.067437 Nov 27 02:08:10 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 343/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:08:10 2023] GET /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd => generated 1205 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:08:13 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-ca1a9ecf-44c4-4488-b0a4-e45b384435b5 req-46d0dc02-acc1-439e-9ffc-5a5cff3e6cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d54b1b-4275-4929-b1af-1b216b8971dd", "tag": "9609fe58-4ecc-4f67-88b6-45a51dadd48f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ca1a9ecf-44c4-4488-b0a4-e45b384435b5 req-46d0dc02-acc1-439e-9ffc-5a5cff3e6cd6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ca1a9ecf-44c4-4488-b0a4-e45b384435b5 req-46d0dc02-acc1-439e-9ffc-5a5cff3e6cd6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:13 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ca1a9ecf-44c4-4488-b0a4-e45b384435b5 req-46d0dc02-acc1-439e-9ffc-5a5cff3e6cd6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-ca1a9ecf-44c4-4488-b0a4-e45b384435b5 req-46d0dc02-acc1-439e-9ffc-5a5cff3e6cd6 service nova] Creating event network-changed:9609fe58-4ecc-4f67-88b6-45a51dadd48f for instance 59d54b1b-4275-4929-b1af-1b216b8971dd on user Nov 27 02:08:13 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-ca1a9ecf-44c4-4488-b0a4-e45b384435b5 req-46d0dc02-acc1-439e-9ffc-5a5cff3e6cd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033258 Nov 27 02:08:13 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 344/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-9214d7bd-c860-44e6-a55e-edf2f9b5d2f1 req-9df733e5-f916-41a5-bb33-bfce8b045813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d54b1b-4275-4929-b1af-1b216b8971dd", "name": "network-vif-plugged", "status": "completed", "tag": "9609fe58-4ecc-4f67-88b6-45a51dadd48f"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9214d7bd-c860-44e6-a55e-edf2f9b5d2f1 req-9df733e5-f916-41a5-bb33-bfce8b045813 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9214d7bd-c860-44e6-a55e-edf2f9b5d2f1 req-9df733e5-f916-41a5-bb33-bfce8b045813 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9214d7bd-c860-44e6-a55e-edf2f9b5d2f1 req-9df733e5-f916-41a5-bb33-bfce8b045813 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-9214d7bd-c860-44e6-a55e-edf2f9b5d2f1 req-9df733e5-f916-41a5-bb33-bfce8b045813 service nova] Creating event network-vif-plugged:9609fe58-4ecc-4f67-88b6-45a51dadd48f for instance 59d54b1b-4275-4929-b1af-1b216b8971dd on user Nov 27 02:08:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-9214d7bd-c860-44e6-a55e-edf2f9b5d2f1 req-9df733e5-f916-41a5-bb33-bfce8b045813 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046569 Nov 27 02:08:14 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 349/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:16 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-3435aaef-9da5-4713-9571-4e05ed84af2c req-d82bfbea-cbc9-473e-be2a-0c5e5becd307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d54b1b-4275-4929-b1af-1b216b8971dd", "name": "network-vif-plugged", "status": "completed", "tag": "9609fe58-4ecc-4f67-88b6-45a51dadd48f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3435aaef-9da5-4713-9571-4e05ed84af2c req-d82bfbea-cbc9-473e-be2a-0c5e5becd307 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3435aaef-9da5-4713-9571-4e05ed84af2c req-d82bfbea-cbc9-473e-be2a-0c5e5becd307 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-3435aaef-9da5-4713-9571-4e05ed84af2c req-d82bfbea-cbc9-473e-be2a-0c5e5becd307 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-3435aaef-9da5-4713-9571-4e05ed84af2c req-d82bfbea-cbc9-473e-be2a-0c5e5becd307 service nova] Creating event network-vif-plugged:9609fe58-4ecc-4f67-88b6-45a51dadd48f for instance 59d54b1b-4275-4929-b1af-1b216b8971dd on user Nov 27 02:08:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-3435aaef-9da5-4713-9571-4e05ed84af2c req-d82bfbea-cbc9-473e-be2a-0c5e5becd307 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032065 Nov 27 02:08:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 344/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 11fa880a-3dc3-4455-9d4b-967c16beed5c] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] HTTP exception thrown: Instance 11fa880a-3dc3-4455-9d4b-967c16beed5c could not be found. Nov 27 02:08:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Returning 404 to user: Instance 11fa880a-3dc3-4455-9d4b-967c16beed5c could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:08:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7db70d75-da46-46a0-ad3e-da6c3d08cf9c tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c" status: 404 len: 111 microversion: 2.87 time: 0.038946 Nov 27 02:08:30 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 345/1038] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:08:30 2023] GET /compute/v2.1/servers/11fa880a-3dc3-4455-9d4b-967c16beed5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:30 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:08:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-65883e50-dc31-42f7-ae4d-1009be56dae3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 204 len: 0 microversion: 2.87 time: 0.204086 Nov 27 02:08:31 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 350/1039] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 02:08:30 2023] DELETE /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=14 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:08:31 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:08:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-446666d5-b02e-4ff8-94af-14306eb2f671 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 200 len: 1774 microversion: 2.87 time: 0.340027 Nov 27 02:08:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 345/1040] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:08:31 2023] GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 1774 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 27 02:08:31 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-91f27fd7-7bbb-4402-9037-6fdb390d4ee0 req-9955ee06-c5f4-4090-9f84-2fd07c607286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-unplugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-91f27fd7-7bbb-4402-9037-6fdb390d4ee0 req-9955ee06-c5f4-4090-9f84-2fd07c607286 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-91f27fd7-7bbb-4402-9037-6fdb390d4ee0 req-9955ee06-c5f4-4090-9f84-2fd07c607286 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:31 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-91f27fd7-7bbb-4402-9037-6fdb390d4ee0 req-9955ee06-c5f4-4090-9f84-2fd07c607286 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-91f27fd7-7bbb-4402-9037-6fdb390d4ee0 req-9955ee06-c5f4-4090-9f84-2fd07c607286 service nova] Creating event network-vif-unplugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 02:08:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-91f27fd7-7bbb-4402-9037-6fdb390d4ee0 req-9955ee06-c5f4-4090-9f84-2fd07c607286 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031984 Nov 27 02:08:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 346/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-4d755b96-94d6-4eae-a78c-b2b44d759f53 req-c8e960b3-8834-4e47-88e7-5af624f8bd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-deleted", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4d755b96-94d6-4eae-a78c-b2b44d759f53 req-c8e960b3-8834-4e47-88e7-5af624f8bd8a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4d755b96-94d6-4eae-a78c-b2b44d759f53 req-c8e960b3-8834-4e47-88e7-5af624f8bd8a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4d755b96-94d6-4eae-a78c-b2b44d759f53 req-c8e960b3-8834-4e47-88e7-5af624f8bd8a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-4d755b96-94d6-4eae-a78c-b2b44d759f53 req-c8e960b3-8834-4e47-88e7-5af624f8bd8a service nova] Creating event network-vif-deleted:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 02:08:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-4d755b96-94d6-4eae-a78c-b2b44d759f53 req-c8e960b3-8834-4e47-88e7-5af624f8bd8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046435 Nov 27 02:08:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 351/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-06ceb5ed-888e-4fda-9b47-582e5288850e req-45e9e816-a2bf-4d9a-a669-47e0eb4cad6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a533e7c-73d1-4422-b8bd-134b2dea325f", "name": "network-vif-plugged", "status": "completed", "tag": "40e6efd1-d841-456d-9c43-72805b281ad8"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-06ceb5ed-888e-4fda-9b47-582e5288850e req-45e9e816-a2bf-4d9a-a669-47e0eb4cad6e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-06ceb5ed-888e-4fda-9b47-582e5288850e req-45e9e816-a2bf-4d9a-a669-47e0eb4cad6e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-06ceb5ed-888e-4fda-9b47-582e5288850e req-45e9e816-a2bf-4d9a-a669-47e0eb4cad6e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-06ceb5ed-888e-4fda-9b47-582e5288850e req-45e9e816-a2bf-4d9a-a669-47e0eb4cad6e service nova] Creating event network-vif-plugged:40e6efd1-d841-456d-9c43-72805b281ad8 for instance 3a533e7c-73d1-4422-b8bd-134b2dea325f on user Nov 27 02:08:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-06ceb5ed-888e-4fda-9b47-582e5288850e req-45e9e816-a2bf-4d9a-a669-47e0eb4cad6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030034 Nov 27 02:08:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 346/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 52edffde-5d81-4b3e-9e14-6558bec163f9 could not be found. Nov 27 02:08:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 52edffde-5d81-4b3e-9e14-6558bec163f9 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:08:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-f2b067ab-57a3-481b-be98-c3fda10218b2 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9" status: 404 len: 111 microversion: 2.1 time: 0.274142 Nov 27 02:08:52 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 347/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:08:52 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9 => generated 111 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:08:52 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:52 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c2d6eb70-c234-438e-9250-4944e39d3e9d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '.version_select at 0x7f364af2ad40>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c2d6eb70-c234-438e-9250-4944e39d3e9d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344459915" status: 202 len: 0 microversion: 2.1 time: 0.028504 Nov 27 02:08:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 352/1045] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 02:08:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1344459915 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:08:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:08:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d5e28b25-3bd9-4b15-a888-20171d4a473f tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: .version_select at 0x7f364aeb57e0>, body: {"keypair": {"name": "tempest-keypair-1086109411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPY9lHHywYGvjGAH9e21QClO6Coh/9rBG/MCaL15LfG78kodnrmZiiZFen5+H/nu8d6TAsEgyd+9ynMCpiQeet6InSUHLdx4M20Ok4n1ogHFKnCbG5zLWiZzgxdLMaUQg=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:53 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-d5e28b25-3bd9-4b15-a888-20171d4a473f tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for project 5da185c008a949dca58184441ccb0a41. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:08:53 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-d5e28b25-3bd9-4b15-a888-20171d4a473f tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for user 82943dfd9046457e9f82f89cba00ff18 and project 5da185c008a949dca58184441ccb0a41. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:08:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d5e28b25-3bd9-4b15-a888-20171d4a473f tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062845 Nov 27 02:08:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 347/1046] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:08:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1715257062", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e82e28e4-25ab-4f21-9e45-49763803697d"}], "security_groups": [{"name": "tempest-securitygroup--1628531872"}], "key_name": "tempest-keypair-1086109411", "user_data": "}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] validate_networks() for [('e82e28e4-25ab-4f21-9e45-49763803697d', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for project 5da185c008a949dca58184441ccb0a41. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Getting quotas for user 82943dfd9046457e9f82f89cba00ff18 and project 5da185c008a949dca58184441ccb0a41. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:08:55 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:08:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-8c8b3f43-cdf4-4d0c-9e80-2ad73641b81a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.770759 Nov 27 02:08:55 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 348/1047] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:08:55 2023] POST /compute/v2.1/servers => generated 400 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:08:55 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-62bee957-3deb-45f4-a412-b830681577a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:55 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-62bee957-3deb-45f4-a412-b830681577a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:55 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-62bee957-3deb-45f4-a412-b830681577a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:08:55 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-62bee957-3deb-45f4-a412-b830681577a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56" status: 200 len: 1234 microversion: 2.1 time: 0.078148 Nov 27 02:08:55 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 353/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:08:55 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56 => generated 1234 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:08:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-122cfdff-606d-4426-8c06-acce30bf4913 req-aa926afb-b464-4340-9722-fa438f67a252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3a26bc-e3a1-4de8-a74a-fc9506969a56", "tag": "f474476b-f618-426a-8cfd-6c1e2e12f783"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:08:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-122cfdff-606d-4426-8c06-acce30bf4913 req-aa926afb-b464-4340-9722-fa438f67a252 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-122cfdff-606d-4426-8c06-acce30bf4913 req-aa926afb-b464-4340-9722-fa438f67a252 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-122cfdff-606d-4426-8c06-acce30bf4913 req-aa926afb-b464-4340-9722-fa438f67a252 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:08:58 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:08:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:08:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:08:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:08:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-122cfdff-606d-4426-8c06-acce30bf4913 req-aa926afb-b464-4340-9722-fa438f67a252 service nova] Creating event network-changed:f474476b-f618-426a-8cfd-6c1e2e12f783 for instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 on user Nov 27 02:08:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-122cfdff-606d-4426-8c06-acce30bf4913 req-aa926afb-b464-4340-9722-fa438f67a252 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074820 Nov 27 02:08:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 348/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:08:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:08:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-369435cb-0e94-4e14-9248-1c24e75e4604 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057737 Nov 27 02:08:58 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 349/1050] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:08:58 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:09:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-3ce9bb71-09e4-415c-a7d3-55288e3069e2 req-ce04edd4-d835-42c4-9927-dd64297a7b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3a26bc-e3a1-4de8-a74a-fc9506969a56", "name": "network-vif-plugged", "status": "completed", "tag": "f474476b-f618-426a-8cfd-6c1e2e12f783"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3ce9bb71-09e4-415c-a7d3-55288e3069e2 req-ce04edd4-d835-42c4-9927-dd64297a7b4e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3ce9bb71-09e4-415c-a7d3-55288e3069e2 req-ce04edd4-d835-42c4-9927-dd64297a7b4e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3ce9bb71-09e4-415c-a7d3-55288e3069e2 req-ce04edd4-d835-42c4-9927-dd64297a7b4e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-3ce9bb71-09e4-415c-a7d3-55288e3069e2 req-ce04edd4-d835-42c4-9927-dd64297a7b4e service nova] Creating event network-vif-plugged:f474476b-f618-426a-8cfd-6c1e2e12f783 for instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 on user Nov 27 02:09:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-3ce9bb71-09e4-415c-a7d3-55288e3069e2 req-ce04edd4-d835-42c4-9927-dd64297a7b4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034886 Nov 27 02:09:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 354/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:09:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: 59d54b1b-4275-4929-b1af-1b216b8971dd] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:00 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027d765937b430d9fbcdbc44f7dede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c187845e2645e3bcf55d62c94ff431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:09:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-34e3c5a5-2bd6-4a44-889c-bc86a4427117 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd" status: 200 len: 1483 microversion: 2.1 time: 0.319519 Nov 27 02:09:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 349/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:09:00 2023] GET /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd => generated 1483 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:09:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-14ca675a-40d3-4c21-99a5-4be30b54708f req-8a4b1493-2a6a-43b5-8bb3-a318e1e51e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3a26bc-e3a1-4de8-a74a-fc9506969a56", "name": "network-vif-plugged", "status": "completed", "tag": "f474476b-f618-426a-8cfd-6c1e2e12f783"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-14ca675a-40d3-4c21-99a5-4be30b54708f req-8a4b1493-2a6a-43b5-8bb3-a318e1e51e08 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-14ca675a-40d3-4c21-99a5-4be30b54708f req-8a4b1493-2a6a-43b5-8bb3-a318e1e51e08 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-14ca675a-40d3-4c21-99a5-4be30b54708f req-8a4b1493-2a6a-43b5-8bb3-a318e1e51e08 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-14ca675a-40d3-4c21-99a5-4be30b54708f req-8a4b1493-2a6a-43b5-8bb3-a318e1e51e08 service nova] Creating event network-vif-plugged:f474476b-f618-426a-8cfd-6c1e2e12f783 for instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 on user Nov 27 02:09:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-14ca675a-40d3-4c21-99a5-4be30b54708f req-8a4b1493-2a6a-43b5-8bb3-a318e1e51e08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035850 Nov 27 02:09:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 350/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:09:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c44f5743-c8de-4667-9c32-05668bb90a16 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.317379 Nov 27 02:09:10 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 355/1054] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:09:10 2023] GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b/os-interface => generated 283 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:09:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-4532cd1a-7458-440e-adba-42094137515a req-3ff54eba-c851-4bcf-8f06-1837c38c4c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47255513-0bc4-4344-ba45-2798e920c44b", "tag": "1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4532cd1a-7458-440e-adba-42094137515a req-3ff54eba-c851-4bcf-8f06-1837c38c4c82 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4532cd1a-7458-440e-adba-42094137515a req-3ff54eba-c851-4bcf-8f06-1837c38c4c82 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4532cd1a-7458-440e-adba-42094137515a req-3ff54eba-c851-4bcf-8f06-1837c38c4c82 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4532cd1a-7458-440e-adba-42094137515a req-3ff54eba-c851-4bcf-8f06-1837c38c4c82 service nova] Creating event network-changed:1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600 for instance 47255513-0bc4-4344-ba45-2798e920c44b on user Nov 27 02:09:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-4532cd1a-7458-440e-adba-42094137515a req-3ff54eba-c851-4bcf-8f06-1837c38c4c82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060118 Nov 27 02:09:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 350/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a5b0000-a93b-4827-8d51-78ef4bc0bcac", "device": "/dev/vdb"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-39be6ad8-fbca-43f4-b5af-c792514cef79 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "POST /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310320 Nov 27 02:09:12 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 351/1056] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:09:12 2023] POST /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: 3a533e7c-73d1-4422-b8bd-134b2dea325f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] HTTP exception thrown: Instance 3a533e7c-73d1-4422-b8bd-134b2dea325f could not be found. Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Returning 404 to user: Instance 3a533e7c-73d1-4422-b8bd-134b2dea325f could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:09:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2e6a7d5e-e1fa-497d-810f-42c1c160b87f tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f" status: 404 len: 111 microversion: 2.87 time: 0.034069 Nov 27 02:09:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 356/1057] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:09:21 2023] GET /compute/v2.1/servers/3a533e7c-73d1-4422-b8bd-134b2dea325f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:09:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a67967f7-b05e-4237-80c3-4bdf61420e8f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0" status: 204 len: 0 microversion: 2.1 time: 0.139806 Nov 27 02:09:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 351/1058] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:09:21 2023] DELETE /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:09:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:21 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:09:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-acafade7-32a8-41bb-9100-cbc2ba03dade tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291" status: 204 len: 0 microversion: 2.87 time: 0.154573 Nov 27 02:09:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 357/1059] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Nov 27 02:09:21 2023] DELETE /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-bfeaf5b8-cae6-4dc6-a164-7af6b7db7974 req-d65052e3-dcc2-49ec-9bcd-8fb39e23a565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a110ae5-60a1-4aa7-9018-5b57f10bebd0", "name": "network-vif-unplugged", "status": "completed", "tag": "bdf37155-3ad4-484a-853d-a94a63df3cc0"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bfeaf5b8-cae6-4dc6-a164-7af6b7db7974 req-d65052e3-dcc2-49ec-9bcd-8fb39e23a565 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bfeaf5b8-cae6-4dc6-a164-7af6b7db7974 req-d65052e3-dcc2-49ec-9bcd-8fb39e23a565 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bfeaf5b8-cae6-4dc6-a164-7af6b7db7974 req-d65052e3-dcc2-49ec-9bcd-8fb39e23a565 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-bfeaf5b8-cae6-4dc6-a164-7af6b7db7974 req-d65052e3-dcc2-49ec-9bcd-8fb39e23a565 service nova] Creating event network-vif-unplugged:bdf37155-3ad4-484a-853d-a94a63df3cc0 for instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 on user Nov 27 02:09:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-bfeaf5b8-cae6-4dc6-a164-7af6b7db7974 req-d65052e3-dcc2-49ec-9bcd-8fb39e23a565 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068806 Nov 27 02:09:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 358/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:09:22 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb2a6cd63c845fdb9a3b48e60d91a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8751348fc0a34723a00ef1c20a10ca2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:09:22 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6389ea9b-f4e1-4a40-9723-acc13f0b8a88 tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0" status: 200 len: 1719 microversion: 2.1 time: 0.507513 Nov 27 02:09:22 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 352/1061] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:09:21 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0 => generated 1719 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:09:22 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:09:22 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:09:22 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '357d7d579c284bcd836dd8075476d5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b168d75a030e425886b18204a7173843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:09:22 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-84a9e570-9c8b-4223-baba-f1eab1ecb27e tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291" status: 200 len: 1695 microversion: 2.87 time: 0.377913 Nov 27 02:09:22 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 352/1062] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:09:21 2023] GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291 => generated 1695 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 27 02:09:24 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a110ae5-60a1-4aa7-9018-5b57f10bebd0", "name": "network-vif-plugged", "status": "completed", "tag": "bdf37155-3ad4-484a-853d-a94a63df3cc0"}, {"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-unplugged", "status": "completed", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}, {"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-plugged", "status": "completed", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}, {"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-plugged", "status": "completed", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}, {"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-plugged", "status": "completed", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}, {"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-unplugged", "status": "completed", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}, {"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-plugged", "status": "completed", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:24 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Creating event network-vif-plugged:bdf37155-3ad4-484a-853d-a94a63df3cc0 for instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 on user Nov 27 02:09:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Creating event network-vif-unplugged:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 02:09:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Creating event network-vif-plugged:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 02:09:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Creating event network-vif-plugged:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 02:09:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Creating event network-vif-plugged:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 02:09:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Creating event network-vif-unplugged:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 02:09:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] Creating event network-vif-plugged:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 02:09:24 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-052f725f-705c-43cb-82c7-b4e94ba480b6 req-ee08cee4-900d-4519-8edf-56d7deff4d3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1213 microversion: 2.1 time: 0.053436 Nov 27 02:09:24 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 359/1063] 10.0.0.210 () {68 vars in 1395 bytes} [Mon Nov 27 02:09:24 2023] POST /compute/v2.1/os-server-external-events => generated 1213 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:09:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-e229196a-4065-42e4-94ae-94cab3f68716 req-27a47a80-eb7d-48cf-a292-78c3bd0f7a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfb37a0-9fbf-4916-8a20-b54bf47e8291", "name": "network-vif-deleted", "tag": "defac3d6-5581-472a-a1f3-1b327582b491"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e229196a-4065-42e4-94ae-94cab3f68716 req-27a47a80-eb7d-48cf-a292-78c3bd0f7a38 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e229196a-4065-42e4-94ae-94cab3f68716 req-27a47a80-eb7d-48cf-a292-78c3bd0f7a38 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e229196a-4065-42e4-94ae-94cab3f68716 req-27a47a80-eb7d-48cf-a292-78c3bd0f7a38 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e229196a-4065-42e4-94ae-94cab3f68716 req-27a47a80-eb7d-48cf-a292-78c3bd0f7a38 service nova] Creating event network-vif-deleted:defac3d6-5581-472a-a1f3-1b327582b491 for instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 on user Nov 27 02:09:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-e229196a-4065-42e4-94ae-94cab3f68716 req-27a47a80-eb7d-48cf-a292-78c3bd0f7a38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037614 Nov 27 02:09:24 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 353/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:09:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:09:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-58ed4a1b-0c55-450f-b3bb-04fcf0b58dc1 req-7b9c1a41-4e7e-4f52-beaf-4c7973456da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a110ae5-60a1-4aa7-9018-5b57f10bebd0", "name": "network-vif-deleted", "tag": "bdf37155-3ad4-484a-853d-a94a63df3cc0"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-58ed4a1b-0c55-450f-b3bb-04fcf0b58dc1 req-7b9c1a41-4e7e-4f52-beaf-4c7973456da5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-58ed4a1b-0c55-450f-b3bb-04fcf0b58dc1 req-7b9c1a41-4e7e-4f52-beaf-4c7973456da5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-58ed4a1b-0c55-450f-b3bb-04fcf0b58dc1 req-7b9c1a41-4e7e-4f52-beaf-4c7973456da5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-58ed4a1b-0c55-450f-b3bb-04fcf0b58dc1 req-7b9c1a41-4e7e-4f52-beaf-4c7973456da5 service nova] Creating event network-vif-deleted:bdf37155-3ad4-484a-853d-a94a63df3cc0 for instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 on user Nov 27 02:09:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-58ed4a1b-0c55-450f-b3bb-04fcf0b58dc1 req-7b9c1a41-4e7e-4f52-beaf-4c7973456da5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030071 Nov 27 02:09:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 353/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:09:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:37 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lazy-loading 'services' on Instance uuid 47255513-0bc4-4344-ba45-2798e920c44b {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:09:37 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e2c1cf2e-4693-492f-bfbb-fc1f95242de6 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b/os-volume_attachments/2a5b0000-a93b-4827-8d51-78ef4bc0bcac" status: 202 len: 0 microversion: 2.1 time: 0.172505 Nov 27 02:09:37 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 360/1066] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:09:37 2023] DELETE /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b/os-volume_attachments/2a5b0000-a93b-4827-8d51-78ef4bc0bcac => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:37 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:09:37 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-93bc2527-0dc4-47ad-b4eb-5afb04d5ddcf tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b" status: 204 len: 0 microversion: 2.1 time: 0.133057 Nov 27 02:09:37 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 354/1067] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:09:37 2023] DELETE /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:37 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4874ba5054e843be8abb960e24d90c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd748cef1b564d42affdddac5e7e6d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:09:37 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5bec48c4-1b4c-4d84-af3d-f75bd429dc7b tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b" status: 200 len: 1714 microversion: 2.1 time: 0.227875 Nov 27 02:09:37 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 354/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:09:37 2023] GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b => generated 1714 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:09:45 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:09:45 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:09:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:45 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:46 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:09:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-f131d51b-4ebf-4dfd-b229-297e8855939e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56" status: 200 len: 1544 microversion: 2.1 time: 0.202509 Nov 27 02:09:46 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 361/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:09:45 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56 => generated 1544 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:09:59 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-c60a984a-07e5-438a-9cc7-22d283381040 req-25812d4d-b503-420c-a473-38afb727be13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47255513-0bc4-4344-ba45-2798e920c44b", "name": "network-vif-unplugged", "status": "completed", "tag": "1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:09:59 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:59 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:09:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c60a984a-07e5-438a-9cc7-22d283381040 req-25812d4d-b503-420c-a473-38afb727be13 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:09:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c60a984a-07e5-438a-9cc7-22d283381040 req-25812d4d-b503-420c-a473-38afb727be13 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:09:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c60a984a-07e5-438a-9cc7-22d283381040 req-25812d4d-b503-420c-a473-38afb727be13 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:09:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-c60a984a-07e5-438a-9cc7-22d283381040 req-25812d4d-b503-420c-a473-38afb727be13 service nova] Creating event network-vif-unplugged:1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600 for instance 47255513-0bc4-4344-ba45-2798e920c44b on user Nov 27 02:09:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-c60a984a-07e5-438a-9cc7-22d283381040 req-25812d4d-b503-420c-a473-38afb727be13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040415 Nov 27 02:09:59 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 355/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:09:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:00 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:00 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-807ae2a6-da6f-45fe-bcc6-14b48f366849 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Action: 'create', calling method: .version_select at 0x7f364aeb5f30>, body: {"keypair": {"name": "tempest-TestStampPattern-1519476636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVZzc3B0ZGg+Axjd+ptaaq/3weWix2AU5+Fm/8CgBGZmZjBgl3/zyOnYooYCP8g0zMBpMfzvYZMkGirj5XeFOud8m3oJVJMRd8Hm539YQloBmHzudWiV/0KgCa9ny4uCw=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:00 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-807ae2a6-da6f-45fe-bcc6-14b48f366849 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Getting quotas for project 198c6d978d68486fbcde872f4301619e. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:10:00 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-807ae2a6-da6f-45fe-bcc6-14b48f366849 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Getting quotas for user 6feb3c5ea00745cd815858eec5d3f913 and project 198c6d978d68486fbcde872f4301619e. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:10:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-807ae2a6-da6f-45fe-bcc6-14b48f366849 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.153495 Nov 27 02:10:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 355/1071] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:10:00 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: 59d54b1b-4275-4929-b1af-1b216b8971dd] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:01 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: 59d54b1b-4275-4929-b1af-1b216b8971dd] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:10:01 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-99386be3-c3f3-4cf3-9639-fc58cef72d6c req-2a06dc3e-2f84-4b1b-bd59-bbf698252b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47255513-0bc4-4344-ba45-2798e920c44b", "name": "network-vif-deleted", "tag": "1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-99386be3-c3f3-4cf3-9639-fc58cef72d6c req-2a06dc3e-2f84-4b1b-bd59-bbf698252b08 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-99386be3-c3f3-4cf3-9639-fc58cef72d6c req-2a06dc3e-2f84-4b1b-bd59-bbf698252b08 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-99386be3-c3f3-4cf3-9639-fc58cef72d6c req-2a06dc3e-2f84-4b1b-bd59-bbf698252b08 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-99386be3-c3f3-4cf3-9639-fc58cef72d6c req-2a06dc3e-2f84-4b1b-bd59-bbf698252b08 service nova] Creating event network-vif-deleted:1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600 for instance 47255513-0bc4-4344-ba45-2798e920c44b on user Nov 27 02:10:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-99386be3-c3f3-4cf3-9639-fc58cef72d6c req-2a06dc3e-2f84-4b1b-bd59-bbf698252b08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035734 Nov 27 02:10:01 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 356/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:01 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-44b60418-ba7b-44ba-92d7-9d9980396bee tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd" status: 204 len: 0 microversion: 2.1 time: 0.133703 Nov 27 02:10:01 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 362/1073] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:10:01 2023] DELETE /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: 59d54b1b-4275-4929-b1af-1b216b8971dd] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:01 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-76d7c748-df83-4d6b-835b-5d77a26b23b5 req-78b35626-a94c-4783-81bd-685396a3db9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47255513-0bc4-4344-ba45-2798e920c44b", "name": "network-vif-plugged", "status": "completed", "tag": "1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-76d7c748-df83-4d6b-835b-5d77a26b23b5 req-78b35626-a94c-4783-81bd-685396a3db9e service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-76d7c748-df83-4d6b-835b-5d77a26b23b5 req-78b35626-a94c-4783-81bd-685396a3db9e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-76d7c748-df83-4d6b-835b-5d77a26b23b5 req-78b35626-a94c-4783-81bd-685396a3db9e service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-76d7c748-df83-4d6b-835b-5d77a26b23b5 req-78b35626-a94c-4783-81bd-685396a3db9e service nova] Creating event network-vif-plugged:1d0fc0e4-5c3b-4cd9-b3ba-6f6e844eb600 for instance 47255513-0bc4-4344-ba45-2798e920c44b on user Nov 27 02:10:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-76d7c748-df83-4d6b-835b-5d77a26b23b5 req-78b35626-a94c-4783-81bd-685396a3db9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041947 Nov 27 02:10:01 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 357/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:01 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8027d765937b430d9fbcdbc44f7dede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c187845e2645e3bcf55d62c94ff431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:10:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-60e7ffb3-9280-4cde-b469-4f3207a16826 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd" status: 200 len: 1489 microversion: 2.1 time: 0.259169 Nov 27 02:10:01 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 356/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:10:01 2023] GET /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd => generated 1489 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-793497295", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "key_name": "tempest-TestStampPattern-1519476636", "security_groups": [{"name": "tempest-secgroup-smoke-879619732"}], "networks": [{"uuid": "4e4d5d1d-7907-4b52-a20a-9fc221084d82"}]}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] validate_networks() for [('4e4d5d1d-7907-4b52-a20a-9fc221084d82', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Getting quotas for project 198c6d978d68486fbcde872f4301619e. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:10:02 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Getting quotas for user 6feb3c5ea00745cd815858eec5d3f913 and project 198c6d978d68486fbcde872f4301619e. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:10:03 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:10:03 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:10:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b14bafd6-77d3-43d2-93e8-ac9ef0a548a0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.653984 Nov 27 02:10:03 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 363/1076] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:10:02 2023] POST /compute/v2.1/servers => generated 403 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:10:03 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-e51cf13d-b559-4441-b13a-8fca63f57cf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:03 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-e51cf13d-b559-4441-b13a-8fca63f57cf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:03 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-e51cf13d-b559-4441-b13a-8fca63f57cf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6feb3c5ea00745cd815858eec5d3f913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198c6d978d68486fbcde872f4301619e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:10:03 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-e51cf13d-b559-4441-b13a-8fca63f57cf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211" status: 200 len: 1234 microversion: 2.1 time: 0.178375 Nov 27 02:10:03 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 358/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:10:03 2023] GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211 => generated 1234 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 02:10:03 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-7421a013-4ba7-4c09-bb16-1fce140c92b1 req-ca81e81e-5b0a-485a-a338-c6ef3135969c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d54b1b-4275-4929-b1af-1b216b8971dd", "name": "network-vif-deleted", "tag": "9609fe58-4ecc-4f67-88b6-45a51dadd48f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-7421a013-4ba7-4c09-bb16-1fce140c92b1 req-ca81e81e-5b0a-485a-a338-c6ef3135969c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-7421a013-4ba7-4c09-bb16-1fce140c92b1 req-ca81e81e-5b0a-485a-a338-c6ef3135969c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-7421a013-4ba7-4c09-bb16-1fce140c92b1 req-ca81e81e-5b0a-485a-a338-c6ef3135969c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-7421a013-4ba7-4c09-bb16-1fce140c92b1 req-ca81e81e-5b0a-485a-a338-c6ef3135969c service nova] Creating event network-vif-deleted:9609fe58-4ecc-4f67-88b6-45a51dadd48f for instance 59d54b1b-4275-4929-b1af-1b216b8971dd on user Nov 27 02:10:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-7421a013-4ba7-4c09-bb16-1fce140c92b1 req-ca81e81e-5b0a-485a-a338-c6ef3135969c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030437 Nov 27 02:10:03 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 357/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:10:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:05 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-7a95bdcd-7f67-407f-a0fc-9dd870f7fd45 req-21b86021-de29-47a2-8c56-374d6aa72e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829426f9-7eb2-4ac2-a1b4-ab29eccdc211", "tag": "49152022-073e-4472-a5b5-d321dfc65eaf"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-7a95bdcd-7f67-407f-a0fc-9dd870f7fd45 req-21b86021-de29-47a2-8c56-374d6aa72e03 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-7a95bdcd-7f67-407f-a0fc-9dd870f7fd45 req-21b86021-de29-47a2-8c56-374d6aa72e03 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-7a95bdcd-7f67-407f-a0fc-9dd870f7fd45 req-21b86021-de29-47a2-8c56-374d6aa72e03 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:05 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-7a95bdcd-7f67-407f-a0fc-9dd870f7fd45 req-21b86021-de29-47a2-8c56-374d6aa72e03 service nova] Creating event network-changed:49152022-073e-4472-a5b5-d321dfc65eaf for instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 on user Nov 27 02:10:05 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-7a95bdcd-7f67-407f-a0fc-9dd870f7fd45 req-21b86021-de29-47a2-8c56-374d6aa72e03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029551 Nov 27 02:10:05 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 364/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:10:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:07 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-041d8a30-4810-4abf-9e29-71609aa0623b req-822947e8-2201-45da-80bb-ae4bf9050195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829426f9-7eb2-4ac2-a1b4-ab29eccdc211", "name": "network-vif-plugged", "status": "completed", "tag": "49152022-073e-4472-a5b5-d321dfc65eaf"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-041d8a30-4810-4abf-9e29-71609aa0623b req-822947e8-2201-45da-80bb-ae4bf9050195 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-041d8a30-4810-4abf-9e29-71609aa0623b req-822947e8-2201-45da-80bb-ae4bf9050195 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:07 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-041d8a30-4810-4abf-9e29-71609aa0623b req-822947e8-2201-45da-80bb-ae4bf9050195 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:07 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-041d8a30-4810-4abf-9e29-71609aa0623b req-822947e8-2201-45da-80bb-ae4bf9050195 service nova] Creating event network-vif-plugged:49152022-073e-4472-a5b5-d321dfc65eaf for instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 on user Nov 27 02:10:07 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-041d8a30-4810-4abf-9e29-71609aa0623b req-822947e8-2201-45da-80bb-ae4bf9050195 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031990 Nov 27 02:10:07 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 359/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:10:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-ec4c21b3-fc48-4fdb-8aa0-7c88a5638be7 req-f4daae72-42ff-481d-9501-d00e43709929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829426f9-7eb2-4ac2-a1b4-ab29eccdc211", "name": "network-vif-plugged", "status": "completed", "tag": "49152022-073e-4472-a5b5-d321dfc65eaf"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ec4c21b3-fc48-4fdb-8aa0-7c88a5638be7 req-f4daae72-42ff-481d-9501-d00e43709929 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ec4c21b3-fc48-4fdb-8aa0-7c88a5638be7 req-f4daae72-42ff-481d-9501-d00e43709929 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ec4c21b3-fc48-4fdb-8aa0-7c88a5638be7 req-f4daae72-42ff-481d-9501-d00e43709929 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-ec4c21b3-fc48-4fdb-8aa0-7c88a5638be7 req-f4daae72-42ff-481d-9501-d00e43709929 service nova] Creating event network-vif-plugged:49152022-073e-4472-a5b5-d321dfc65eaf for instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 on user Nov 27 02:10:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-ec4c21b3-fc48-4fdb-8aa0-7c88a5638be7 req-f4daae72-42ff-481d-9501-d00e43709929 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029358 Nov 27 02:10:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 358/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:10:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] [instance: 3a110ae5-60a1-4aa7-9018-5b57f10bebd0] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] HTTP exception thrown: Instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 could not be found. Nov 27 02:10:12 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Returning 404 to user: Instance 3a110ae5-60a1-4aa7-9018-5b57f10bebd0 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:10:12 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-593f8f00-ae37-4bb5-bfbb-017b6df0ccdf tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0" status: 404 len: 111 microversion: 2.1 time: 0.033509 Nov 27 02:10:12 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 365/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:10:12 2023] GET /compute/v2.1/servers/3a110ae5-60a1-4aa7-9018-5b57f10bebd0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] [instance: cdfb37a0-9fbf-4916-8a20-b54bf47e8291] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] HTTP exception thrown: Instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 could not be found. Nov 27 02:10:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] Returning 404 to user: Instance cdfb37a0-9fbf-4916-8a20-b54bf47e8291 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:10:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ed68991e-2ab8-477d-b098-2c57fa8840b3 tempest-ServerBootFromVolumeStableRescueTest-554951466 tempest-ServerBootFromVolumeStableRescueTest-554951466-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291" status: 404 len: 111 microversion: 2.87 time: 0.035093 Nov 27 02:10:12 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 360/1083] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Nov 27 02:10:12 2023] GET /compute/v2.1/servers/cdfb37a0-9fbf-4916-8a20-b54bf47e8291 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 27 02:10:12 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:12 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-9a11a0c5-c2fa-4ea7-9f26-f47f749d2a9f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] Calling method '.version_select at 0x7f364aeb75b0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:12 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-9a11a0c5-c2fa-4ea7-9f26-f47f749d2a9f tempest-SnapshotDataIntegrityTests-1107275169 tempest-SnapshotDataIntegrityTests-1107275169-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756126364" status: 202 len: 0 microversion: 2.1 time: 0.034020 Nov 27 02:10:12 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 359/1084] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 02:10:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756126364 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] [instance: 47255513-0bc4-4344-ba45-2798e920c44b] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] HTTP exception thrown: Instance 47255513-0bc4-4344-ba45-2798e920c44b could not be found. Nov 27 02:10:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Returning 404 to user: Instance 47255513-0bc4-4344-ba45-2798e920c44b could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:10:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3f9da7ce-541b-4e8e-b91c-c909e9dfab84 tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b" status: 404 len: 111 microversion: 2.1 time: 0.039492 Nov 27 02:10:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 366/1085] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:10:27 2023] GET /compute/v2.1/servers/47255513-0bc4-4344-ba45-2798e920c44b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:10:27 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ec3ef739-80e8-44ad-b986-e2b0185af5ff tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] Calling method '.version_select at 0x7f364b2c3370>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:27 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:27 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=14 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:27 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=10 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:27 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ec3ef739-80e8-44ad-b986-e2b0185af5ff tempest-VolumesSnapshotTestJSON-1251684731 tempest-VolumesSnapshotTestJSON-1251684731-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187558695" status: 202 len: 0 microversion: 2.1 time: 0.032223 Nov 27 02:10:27 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 361/1086] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 02:10:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187558695 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=10 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:46 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:46 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-afe279e0-c056-41ee-9f1d-f3e7f34e532d tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.476270 Nov 27 02:10:46 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 360/1087] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:10:46 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-interface => generated 283 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:47 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-29e50e3d-8086-4a6c-8dce-25ffbf957b15 req-03767b84-ade7-4ff6-89bb-293e118002c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3a26bc-e3a1-4de8-a74a-fc9506969a56", "tag": "f474476b-f618-426a-8cfd-6c1e2e12f783"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:47 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:47 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-29e50e3d-8086-4a6c-8dce-25ffbf957b15 req-03767b84-ade7-4ff6-89bb-293e118002c7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-29e50e3d-8086-4a6c-8dce-25ffbf957b15 req-03767b84-ade7-4ff6-89bb-293e118002c7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:47 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-29e50e3d-8086-4a6c-8dce-25ffbf957b15 req-03767b84-ade7-4ff6-89bb-293e118002c7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:47 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-29e50e3d-8086-4a6c-8dce-25ffbf957b15 req-03767b84-ade7-4ff6-89bb-293e118002c7 service nova] Creating event network-changed:f474476b-f618-426a-8cfd-6c1e2e12f783 for instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 on user Nov 27 02:10:47 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-29e50e3d-8086-4a6c-8dce-25ffbf957b15 req-03767b84-ade7-4ff6-89bb-293e118002c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033645 Nov 27 02:10:47 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 367/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:10:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:47 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:47 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-724b8d8d-2dcd-40d7-8a70-85445b6f4d41 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/ips" status: 200 len: 108 microversion: 2.1 time: 0.052995 Nov 27 02:10:47 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 362/1089] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:10:47 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/ips => generated 108 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9299a2b0-3700-455d-94a0-6b03bb272e7b"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:10:52 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] [instance: 59d54b1b-4275-4929-b1af-1b216b8971dd] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] HTTP exception thrown: Instance 59d54b1b-4275-4929-b1af-1b216b8971dd could not be found. Nov 27 02:10:52 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] Returning 404 to user: Instance 59d54b1b-4275-4929-b1af-1b216b8971dd could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:10:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7960ad29-cc1e-4025-88a1-295439273e02 tempest-VolumesActionsTest-1790490732 tempest-VolumesActionsTest-1790490732-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd" status: 404 len: 111 microversion: 2.1 time: 0.319214 Nov 27 02:10:52 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 361/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:10:51 2023] GET /compute/v2.1/servers/59d54b1b-4275-4929-b1af-1b216b8971dd => generated 111 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:10:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-051fb4ff-9aa8-4ddd-9024-24d0c6819e11 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409343 Nov 27 02:10:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 368/1091] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:10:52 2023] POST /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:10:53 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6feb3c5ea00745cd815858eec5d3f913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198c6d978d68486fbcde872f4301619e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:10:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-16da9207-1448-4bac-9e92-248837f31b2d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211" status: 200 len: 1535 microversion: 2.1 time: 0.256569 Nov 27 02:10:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 363/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:10:53 2023] GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211 => generated 1535 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:11:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-180e1d33-fc53-493d-9298-368773827f67 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Action: 'create', calling method: .version_select at 0x7f364aeb7010>, body: {"keypair": {"name": "tempest-keypair-1888126627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI6M0yXVkIrenj1cMLCATQwYoEEn1ENb+ZeQtgMXSL03WEYkk8sts85+leA9vkizZ8j/WntDjHO8qQ1LWfud2wLgDnaJKAiZCMSxBwvhKxvxL1sl0SEvVzvhBQBHJ85Sw=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:00 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-180e1d33-fc53-493d-9298-368773827f67 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Getting quotas for project 7afb522c8af24a3983c8f985fa83a3c4. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:11:00 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-180e1d33-fc53-493d-9298-368773827f67 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Getting quotas for user 288c914eb79447cdb47da5538bdbd80d and project 7afb522c8af24a3983c8f985fa83a3c4. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:11:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-180e1d33-fc53-493d-9298-368773827f67 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071853 Nov 27 02:11:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 362/1093] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:11:00 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:01 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachmentScenario-server-404900581", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "networks": [{"uuid": "ceaf8ee8-18cd-4774-94d1-841dbb3b1901"}], "security_groups": [{"name": "tempest-securitygroup--1978398969"}], "key_name": "tempest-keypair-1888126627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:01 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] validate_networks() for [('ceaf8ee8-18cd-4774-94d1-841dbb3b1901', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Getting quotas for project 7afb522c8af24a3983c8f985fa83a3c4. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Getting quotas for user 288c914eb79447cdb47da5538bdbd80d and project 7afb522c8af24a3983c8f985fa83a3c4. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:11:02 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:11:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b4ca2886-13ee-4b88-aa45-37d2db7eefe9 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.695480 Nov 27 02:11:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 369/1094] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:11:01 2023] POST /compute/v2.1/servers => generated 404 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:11:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ad55d525-dd6c-4fea-b922-42d94c823102 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ad55d525-dd6c-4fea-b922-42d94c823102 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:02 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-ad55d525-dd6c-4fea-b922-42d94c823102 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288c914eb79447cdb47da5538bdbd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afb522c8af24a3983c8f985fa83a3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:11:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ad55d525-dd6c-4fea-b922-42d94c823102 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a" status: 200 len: 1243 microversion: 2.1 time: 0.085868 Nov 27 02:11:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 364/1095] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:11:02 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:11:04 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:04 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-2ad9607a-7930-4173-90a4-ac7a0ef890c2 req-7d47b7e9-b970-467f-ad82-9e3aba131f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f9326a-e64f-4ffb-94a3-638019872d7a", "tag": "4f2044de-61d9-481e-82ed-0d0b5164eff0"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2ad9607a-7930-4173-90a4-ac7a0ef890c2 req-7d47b7e9-b970-467f-ad82-9e3aba131f3f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2ad9607a-7930-4173-90a4-ac7a0ef890c2 req-7d47b7e9-b970-467f-ad82-9e3aba131f3f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2ad9607a-7930-4173-90a4-ac7a0ef890c2 req-7d47b7e9-b970-467f-ad82-9e3aba131f3f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:05 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-2ad9607a-7930-4173-90a4-ac7a0ef890c2 req-7d47b7e9-b970-467f-ad82-9e3aba131f3f service nova] Creating event network-changed:4f2044de-61d9-481e-82ed-0d0b5164eff0 for instance 24f9326a-e64f-4ffb-94a3-638019872d7a on user Nov 27 02:11:05 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-2ad9607a-7930-4173-90a4-ac7a0ef890c2 req-7d47b7e9-b970-467f-ad82-9e3aba131f3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045226 Nov 27 02:11:05 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 363/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:05 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lazy-loading 'services' on Instance uuid dc3a26bc-e3a1-4de8-a74a-fc9506969a56 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:11:05 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-17378a06-b2a0-45d1-9d32-0fedc08ea1c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-volume_attachments/9299a2b0-3700-455d-94a0-6b03bb272e7b" status: 202 len: 0 microversion: 2.1 time: 0.200643 Nov 27 02:11:05 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 370/1097] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:11:05 2023] DELETE /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-volume_attachments/9299a2b0-3700-455d-94a0-6b03bb272e7b => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=10 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:05 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9bdc26d2-648c-4a51-9190-51d6dcd062d0 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065174 Nov 27 02:11:05 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 365/1098] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:11:05 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:07 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-73cc4a74-6abb-486b-bc1d-b819f3512563 req-c36e13a4-7565-4965-9073-7e8f700a4967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f9326a-e64f-4ffb-94a3-638019872d7a", "name": "network-vif-plugged", "status": "completed", "tag": "4f2044de-61d9-481e-82ed-0d0b5164eff0"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-73cc4a74-6abb-486b-bc1d-b819f3512563 req-c36e13a4-7565-4965-9073-7e8f700a4967 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-73cc4a74-6abb-486b-bc1d-b819f3512563 req-c36e13a4-7565-4965-9073-7e8f700a4967 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-73cc4a74-6abb-486b-bc1d-b819f3512563 req-c36e13a4-7565-4965-9073-7e8f700a4967 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-73cc4a74-6abb-486b-bc1d-b819f3512563 req-c36e13a4-7565-4965-9073-7e8f700a4967 service nova] Creating event network-vif-plugged:4f2044de-61d9-481e-82ed-0d0b5164eff0 for instance 24f9326a-e64f-4ffb-94a3-638019872d7a on user Nov 27 02:11:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-73cc4a74-6abb-486b-bc1d-b819f3512563 req-c36e13a4-7565-4965-9073-7e8f700a4967 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075448 Nov 27 02:11:07 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 364/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-4163692d-5ac6-4330-983d-8af318271bd9 req-90164414-d950-418d-b5e2-523586e79b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f9326a-e64f-4ffb-94a3-638019872d7a", "name": "network-vif-plugged", "status": "completed", "tag": "4f2044de-61d9-481e-82ed-0d0b5164eff0"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4163692d-5ac6-4330-983d-8af318271bd9 req-90164414-d950-418d-b5e2-523586e79b3d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4163692d-5ac6-4330-983d-8af318271bd9 req-90164414-d950-418d-b5e2-523586e79b3d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4163692d-5ac6-4330-983d-8af318271bd9 req-90164414-d950-418d-b5e2-523586e79b3d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-4163692d-5ac6-4330-983d-8af318271bd9 req-90164414-d950-418d-b5e2-523586e79b3d service nova] Creating event network-vif-plugged:4f2044de-61d9-481e-82ed-0d0b5164eff0 for instance 24f9326a-e64f-4ffb-94a3-638019872d7a on user Nov 27 02:11:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-4163692d-5ac6-4330-983d-8af318271bd9 req-90164414-d950-418d-b5e2-523586e79b3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035898 Nov 27 02:11:09 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 371/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=10 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:36 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f9b59cf4-08c8-46ea-861d-ef2f65884442 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Action: 'create', calling method: .version_select at 0x7f364b2c2dd0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1339359276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXeulDQ1SuCnO642kQfJG/CEOOM5QrZuNS4ilr0uUi2nBXtLtvfcIZrsfKpw+mlxQi/Mw8tnThoS2cAXONnjfQBXI91RTTEtw2a1cY/+Jgg7VMawTkSprHhm6r6YZ+TeA=="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:36 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-f9b59cf4-08c8-46ea-861d-ef2f65884442 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Getting quotas for project 0c461a06297740aa9f6f6f97d6ced545. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:11:36 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-f9b59cf4-08c8-46ea-861d-ef2f65884442 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Getting quotas for user cd02f3b9aa7c4ff68b45cc6d749adb69 and project 0c461a06297740aa9f6f6f97d6ced545. Resources: {'key_pairs'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:11:36 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-f9b59cf4-08c8-46ea-861d-ef2f65884442 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.345640 Nov 27 02:11:36 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 366/1101] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:11:35 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:11:42 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:42 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:42 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:42 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2013286464", "imageRef": "", "flavorRef": "1", "key_name": "tempest-TestShelveInstance-1339359276", "security_groups": [{"name": "tempest-secgroup-smoke-2143360679"}], "networks": [{"uuid": "d0effe26-90de-4da6-8865-37b870e8e0ad"}], "block_device_mapping_v2": [{"uuid": "8aae0463-a415-433c-9299-018b03059d73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:42 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] validate_networks() for [('d0effe26-90de-4da6-8865-37b870e8e0ad', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Getting quotas for project 0c461a06297740aa9f6f6f97d6ced545. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Getting quotas for user cd02f3b9aa7c4ff68b45cc6d749adb69 and project 0c461a06297740aa9f6f6f97d6ced545. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:11:43 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8aae0463-a415-433c-9299-018b03059d73',volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:11:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3bca2150-341a-48ea-9a86-61a60ad3fd07 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.913258 Nov 27 02:11:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 365/1102] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:11:42 2023] POST /compute/v2.1/servers => generated 404 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:11:43 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-36d95985-7e41-4a45-ae37-a8398b3da84d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:43 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-36d95985-7e41-4a45-ae37-a8398b3da84d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:43 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:43 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-36d95985-7e41-4a45-ae37-a8398b3da84d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02f3b9aa7c4ff68b45cc6d749adb69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c461a06297740aa9f6f6f97d6ced545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:11:43 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-36d95985-7e41-4a45-ae37-a8398b3da84d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 200 len: 1082 microversion: 2.1 time: 0.074331 Nov 27 02:11:43 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 372/1103] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:11:43 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 1082 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 02:11:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-743179ed-5a7d-47e0-8765-ec8d5cc13302 req-27954b12-5806-4ad8-bbff-ff516d4178e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-743179ed-5a7d-47e0-8765-ec8d5cc13302 req-27954b12-5806-4ad8-bbff-ff516d4178e2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-743179ed-5a7d-47e0-8765-ec8d5cc13302 req-27954b12-5806-4ad8-bbff-ff516d4178e2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-743179ed-5a7d-47e0-8765-ec8d5cc13302 req-27954b12-5806-4ad8-bbff-ff516d4178e2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-743179ed-5a7d-47e0-8765-ec8d5cc13302 req-27954b12-5806-4ad8-bbff-ff516d4178e2 service nova] Creating event network-changed:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:11:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-743179ed-5a7d-47e0-8765-ec8d5cc13302 req-27954b12-5806-4ad8-bbff-ff516d4178e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088694 Nov 27 02:11:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 367/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:52 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288c914eb79447cdb47da5538bdbd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afb522c8af24a3983c8f985fa83a3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:11:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5391fa15-d160-47d2-93ac-225f47f1acb6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a" status: 200 len: 1563 microversion: 2.1 time: 0.213549 Nov 27 02:11:52 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 366/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:11:52 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a => generated 1563 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:11:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-e36a876c-835e-4df5-8d0e-8a34a5b7bc6f req-be032b4a-95e2-489c-a799-a765fb7e625c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-plugged", "status": "completed", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:53 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e36a876c-835e-4df5-8d0e-8a34a5b7bc6f req-be032b4a-95e2-489c-a799-a765fb7e625c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e36a876c-835e-4df5-8d0e-8a34a5b7bc6f req-be032b4a-95e2-489c-a799-a765fb7e625c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-e36a876c-835e-4df5-8d0e-8a34a5b7bc6f req-be032b4a-95e2-489c-a799-a765fb7e625c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-e36a876c-835e-4df5-8d0e-8a34a5b7bc6f req-be032b4a-95e2-489c-a799-a765fb7e625c service nova] Creating event network-vif-plugged:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:11:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-e36a876c-835e-4df5-8d0e-8a34a5b7bc6f req-be032b4a-95e2-489c-a799-a765fb7e625c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109252 Nov 27 02:11:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 373/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:53 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6feb3c5ea00745cd815858eec5d3f913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198c6d978d68486fbcde872f4301619e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:11:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-f24fbd2b-ad4a-4ce3-a49e-517ba1358ab5 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211" status: 200 len: 1535 microversion: 2.1 time: 0.224000 Nov 27 02:11:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 368/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:11:53 2023] GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211 => generated 1535 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:11:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:55 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:11:55 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-9140f119-d557-4940-a2fd-d1db382eaffc req-9f688d44-1f58-436d-9f95-c6244e3f383a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-plugged", "status": "completed", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9140f119-d557-4940-a2fd-d1db382eaffc req-9f688d44-1f58-436d-9f95-c6244e3f383a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9140f119-d557-4940-a2fd-d1db382eaffc req-9f688d44-1f58-436d-9f95-c6244e3f383a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-9140f119-d557-4940-a2fd-d1db382eaffc req-9f688d44-1f58-436d-9f95-c6244e3f383a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:55 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-9140f119-d557-4940-a2fd-d1db382eaffc req-9f688d44-1f58-436d-9f95-c6244e3f383a service nova] Creating event network-vif-plugged:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:11:55 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-9140f119-d557-4940-a2fd-d1db382eaffc req-9f688d44-1f58-436d-9f95-c6244e3f383a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034192 Nov 27 02:11:55 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 374/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-c6c8841b-6e4c-4c6a-8cdd-657d18dc1686 req-83f17a4e-ac45-4d64-9fca-96b1174dd601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829426f9-7eb2-4ac2-a1b4-ab29eccdc211", "tag": "49152022-073e-4472-a5b5-d321dfc65eaf"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6c8841b-6e4c-4c6a-8cdd-657d18dc1686 req-83f17a4e-ac45-4d64-9fca-96b1174dd601 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6c8841b-6e4c-4c6a-8cdd-657d18dc1686 req-83f17a4e-ac45-4d64-9fca-96b1174dd601 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-c6c8841b-6e4c-4c6a-8cdd-657d18dc1686 req-83f17a4e-ac45-4d64-9fca-96b1174dd601 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-c6c8841b-6e4c-4c6a-8cdd-657d18dc1686 req-83f17a4e-ac45-4d64-9fca-96b1174dd601 service nova] Creating event network-changed:49152022-073e-4472-a5b5-d321dfc65eaf for instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 on user Nov 27 02:11:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-c6c8841b-6e4c-4c6a-8cdd-657d18dc1686 req-83f17a4e-ac45-4d64-9fca-96b1174dd601 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112664 Nov 27 02:11:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 367/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:55 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "173c1eaf-8756-4f5b-91d0-1c9ac8353753"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:55 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:56 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5bae3787-48ac-4e3c-a40c-aecfe86b6c65 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046893 Nov 27 02:11:56 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 375/1110] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:11:56 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:11:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-138718fb-95dc-499c-99f1-c6cba2796838 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "POST /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278659 Nov 27 02:11:56 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 369/1111] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:11:55 2023] POST /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:56 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:11:56 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7f549ab1-2ed6-4395-b01c-2b271faf4798 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56" status: 204 len: 0 microversion: 2.1 time: 0.151071 Nov 27 02:11:56 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 368/1112] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:11:56 2023] DELETE /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:56 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82943dfd9046457e9f82f89cba00ff18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da185c008a949dca58184441ccb0a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:11:56 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-2acc0389-e639-4377-a9ba-ca0948254af3 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56" status: 200 len: 1668 microversion: 2.1 time: 0.225352 Nov 27 02:11:56 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 376/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:11:56 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56 => generated 1668 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:11:56 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-9729040d-a292-4a58-a576-e9f4264ba1bc req-5a59fe24-c875-4307-ac9f-c35a9ef21148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3a26bc-e3a1-4de8-a74a-fc9506969a56", "name": "network-vif-unplugged", "status": "completed", "tag": "f474476b-f618-426a-8cfd-6c1e2e12f783"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9729040d-a292-4a58-a576-e9f4264ba1bc req-5a59fe24-c875-4307-ac9f-c35a9ef21148 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9729040d-a292-4a58-a576-e9f4264ba1bc req-5a59fe24-c875-4307-ac9f-c35a9ef21148 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9729040d-a292-4a58-a576-e9f4264ba1bc req-5a59fe24-c875-4307-ac9f-c35a9ef21148 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9729040d-a292-4a58-a576-e9f4264ba1bc req-5a59fe24-c875-4307-ac9f-c35a9ef21148 service nova] Creating event network-vif-unplugged:f474476b-f618-426a-8cfd-6c1e2e12f783 for instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 on user Nov 27 02:11:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-9729040d-a292-4a58-a576-e9f4264ba1bc req-5a59fe24-c875-4307-ac9f-c35a9ef21148 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052457 Nov 27 02:11:56 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 370/1114] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:11:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-2c5d12d4-9059-40fa-9de1-847dd15dd325 req-cd886659-b801-4da9-8f2a-db85c1f74ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3a26bc-e3a1-4de8-a74a-fc9506969a56", "name": "network-vif-plugged", "status": "completed", "tag": "f474476b-f618-426a-8cfd-6c1e2e12f783"}, {"server_uuid": "dc3a26bc-e3a1-4de8-a74a-fc9506969a56", "name": "network-vif-deleted", "tag": "f474476b-f618-426a-8cfd-6c1e2e12f783"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:11:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2c5d12d4-9059-40fa-9de1-847dd15dd325 req-cd886659-b801-4da9-8f2a-db85c1f74ada service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:11:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2c5d12d4-9059-40fa-9de1-847dd15dd325 req-cd886659-b801-4da9-8f2a-db85c1f74ada service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:11:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-2c5d12d4-9059-40fa-9de1-847dd15dd325 req-cd886659-b801-4da9-8f2a-db85c1f74ada service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:11:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-2c5d12d4-9059-40fa-9de1-847dd15dd325 req-cd886659-b801-4da9-8f2a-db85c1f74ada service nova] Creating event network-vif-plugged:f474476b-f618-426a-8cfd-6c1e2e12f783 for instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 on user Nov 27 02:11:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-2c5d12d4-9059-40fa-9de1-847dd15dd325 req-cd886659-b801-4da9-8f2a-db85c1f74ada service nova] Creating event network-vif-deleted:f474476b-f618-426a-8cfd-6c1e2e12f783 for instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 on user Nov 27 02:11:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-2c5d12d4-9059-40fa-9de1-847dd15dd325 req-cd886659-b801-4da9-8f2a-db85c1f74ada service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031172 Nov 27 02:11:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 369/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:11:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:06 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lazy-loading 'services' on Instance uuid 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:12:06 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-8b345c6e-ceb8-49ed-b482-e58de9b8bcf1 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments/173c1eaf-8756-4f5b-91d0-1c9ac8353753" status: 202 len: 0 microversion: 2.1 time: 0.219533 Nov 27 02:12:06 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 377/1116] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:12:06 2023] DELETE /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments/173c1eaf-8756-4f5b-91d0-1c9ac8353753 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 27 02:12:06 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:06 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:06 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-8a03543d-15c3-46f6-b96c-c7a5ef102433 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053515 Nov 27 02:12:06 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 371/1117] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:12:06 2023] GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:33 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02f3b9aa7c4ff68b45cc6d749adb69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c461a06297740aa9f6f6f97d6ced545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:12:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-72e63d50-0f87-403f-b83b-a6c71d6a908f tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 200 len: 1432 microversion: 2.1 time: 0.290780 Nov 27 02:12:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 370/1118] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:12:33 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 1432 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=10 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 could not be found. Nov 27 02:12:46 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:46 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3fc0b183-4a17-4285-8654-088a89861ac5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56" status: 404 len: 111 microversion: 2.1 time: 0.066041 Nov 27 02:12:46 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 378/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:12:46 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:46 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-8dc52a50-c84b-4227-9997-5d4b59b12e73 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '.version_select at 0x7f364b390040>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:46 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:12:46 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:12:46 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-8dc52a50-c84b-4227-9997-5d4b59b12e73 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086109411" status: 202 len: 0 microversion: 2.1 time: 0.035811 Nov 27 02:12:46 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 372/1120] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 02:12:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086109411 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:50 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 could not be found. Nov 27 02:12:50 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:50 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7a4e38a3-18d2-41bd-8548-b1ad1635d3c9 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56" status: 404 len: 111 microversion: 2.1 time: 0.031847 Nov 27 02:12:50 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 371/1121] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:12:50 2023] DELETE /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: dc3a26bc-e3a1-4de8-a74a-fc9506969a56] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 could not be found. Nov 27 02:12:50 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance dc3a26bc-e3a1-4de8-a74a-fc9506969a56 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a7a5cf22-1ffe-4102-b7ec-4387379b80b5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56" status: 404 len: 111 microversion: 2.1 time: 0.043692 Nov 27 02:12:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 379/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:12:50 2023] GET /compute/v2.1/servers/dc3a26bc-e3a1-4de8-a74a-fc9506969a56 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:52 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-73d8999e-d2e6-4ef7-b9dc-ad86772b1ff6 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.226161 Nov 27 02:12:52 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 373/1123] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:12:52 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-interface => generated 282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:12:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-516dc191-da17-4ee6-a697-29a831dc6ee1 req-6d483f54-6c4b-4d89-a89f-828eb1ec5609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f9326a-e64f-4ffb-94a3-638019872d7a", "tag": "4f2044de-61d9-481e-82ed-0d0b5164eff0"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:12:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-516dc191-da17-4ee6-a697-29a831dc6ee1 req-6d483f54-6c4b-4d89-a89f-828eb1ec5609 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-516dc191-da17-4ee6-a697-29a831dc6ee1 req-6d483f54-6c4b-4d89-a89f-828eb1ec5609 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-516dc191-da17-4ee6-a697-29a831dc6ee1 req-6d483f54-6c4b-4d89-a89f-828eb1ec5609 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-516dc191-da17-4ee6-a697-29a831dc6ee1 req-6d483f54-6c4b-4d89-a89f-828eb1ec5609 service nova] Creating event network-changed:4f2044de-61d9-481e-82ed-0d0b5164eff0 for instance 24f9326a-e64f-4ffb-94a3-638019872d7a on user Nov 27 02:12:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-516dc191-da17-4ee6-a697-29a831dc6ee1 req-6d483f54-6c4b-4d89-a89f-828eb1ec5609 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032062 Nov 27 02:12:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 372/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:12:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:53 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288c914eb79447cdb47da5538bdbd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afb522c8af24a3983c8f985fa83a3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:12:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e140e038-7c95-4389-b1c5-f01b4ec7d242 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a" status: 200 len: 1563 microversion: 2.1 time: 0.182016 Nov 27 02:12:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 380/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:12:53 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '288c914eb79447cdb47da5538bdbd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afb522c8af24a3983c8f985fa83a3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Searching by: {'deleted': False, 'project_id': '7afb522c8af24a3983c8f985fa83a3c4'} {{(pid=65193) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 52edffde-5d81-4b3e-9e14-6558bec163f9 could not be found. Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 52edffde-5d81-4b3e-9e14-6558bec163f9 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c62a7247-70c5-428c-bd41-4afd9f7ea7a5 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9" status: 404 len: 111 microversion: 2.1 time: 0.027012 Nov 27 02:12:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 373/1126] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:12:54 2023] DELETE /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 52edffde-5d81-4b3e-9e14-6558bec163f9] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 52edffde-5d81-4b3e-9e14-6558bec163f9 could not be found. Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 52edffde-5d81-4b3e-9e14-6558bec163f9 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-b4e215e9-c3f8-4f37-b548-02bb1f26f3c6 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9" status: 404 len: 111 microversion: 2.1 time: 0.030452 Nov 27 02:12:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 381/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:12:54 2023] GET /compute/v2.1/servers/52edffde-5d81-4b3e-9e14-6558bec163f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb could not be found. Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-33862584-01fa-4794-9fae-7b7941919717 tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb" status: 404 len: 111 microversion: 2.1 time: 0.031634 Nov 27 02:12:54 user devstack@n-api.service[65193]: DEBUG nova.compute.multi_cell_list [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65193) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 27 02:12:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 374/1128] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:12:54 2023] DELETE /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 9fa0beed-c279-460c-8dec-9cf2481a8dfb] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb could not be found. Nov 27 02:12:54 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 9fa0beed-c279-460c-8dec-9cf2481a8dfb could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:54 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3c269309-dd2c-45e5-99e0-6074338285be tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb" status: 404 len: 111 microversion: 2.1 time: 0.029052 Nov 27 02:12:54 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 382/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:12:54 2023] GET /compute/v2.1/servers/9fa0beed-c279-460c-8dec-9cf2481a8dfb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6194f7d6-4e0d-4170-963d-b974d561754b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 350 microversion: 2.1 time: 0.163714 Nov 27 02:12:54 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 374/1130] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Nov 27 02:12:54 2023] GET /compute/v2.1/servers => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33fdd72a-77fe-4e8e-85f9-286c415f3ba8"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:54 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-de9d05b8-cd78-4749-a4e3-03a5a11af37e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301663 Nov 27 02:12:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 375/1131] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:12:54 2023] POST /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:12:56 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:56 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:56 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-27eac01d-1b8c-40f3-ae09-aae56a5f520d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044158 Nov 27 02:12:56 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 383/1132] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:12:56 2023] GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 749cda36-ac85-44a0-836a-e7b9cea6f106 could not be found. Nov 27 02:12:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 749cda36-ac85-44a0-836a-e7b9cea6f106 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c3e63174-6ced-4e29-a989-6597efa2660e tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106" status: 404 len: 111 microversion: 2.1 time: 0.030315 Nov 27 02:12:57 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 375/1133] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:12:57 2023] DELETE /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] [instance: 749cda36-ac85-44a0-836a-e7b9cea6f106] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:57 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] HTTP exception thrown: Instance 749cda36-ac85-44a0-836a-e7b9cea6f106 could not be found. Nov 27 02:12:57 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] Returning 404 to user: Instance 749cda36-ac85-44a0-836a-e7b9cea6f106 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:12:57 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-8ef6fbd4-e041-424c-a948-78f9f8dc8e3a tempest-AttachVolumeNegativeTest-1893772593 tempest-AttachVolumeNegativeTest-1893772593-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106" status: 404 len: 111 microversion: 2.1 time: 0.027745 Nov 27 02:12:57 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 376/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:12:57 2023] GET /compute/v2.1/servers/749cda36-ac85-44a0-836a-e7b9cea6f106 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:12:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1341160172"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:12:59 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:12:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:12:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:12:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:12:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-422b5b1f-0380-4216-b89a-77f2dbe14804 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "POST /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/action" status: 202 len: 0 microversion: 2.1 time: 0.809083 Nov 27 02:13:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 384/1135] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 02:12:59 2023] POST /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG nova.compute.api [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:04 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-6c0ba9e5-aa2d-44cb-ac65-968feecba736 req-5d2df93d-11dc-40bd-b258-2f12e6e5488d tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8" status: 200 len: 302 microversion: 2.89 time: 0.147690 Nov 27 02:13:04 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 376/1136] 10.0.0.210 () {66 vars in 1638 bytes} [Mon Nov 27 02:13:03 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 02:13:04 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:04 user devstack@n-api.service[65192]: DEBUG nova.compute.api [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:04 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:04 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-44d40a51-c4c9-4d3a-b664-3d691b7dd923 req-d819ea61-eb58-41a5-b64d-8bad1afba374 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8" status: 200 len: 302 microversion: 2.89 time: 0.088934 Nov 27 02:13:04 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 377/1137] 10.0.0.210 () {66 vars in 1638 bytes} [Mon Nov 27 02:13:04 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8 => generated 302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 02:13:04 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:04 user devstack@n-api.service[65194]: DEBUG nova.compute.api [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-bb59d666-5390-4bc2-a973-afeffc3226bc req-1c93fdea-9b99-418d-958f-543fdc138c09 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8" status: 200 len: 302 microversion: 2.89 time: 0.090911 Nov 27 02:13:04 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 385/1138] 10.0.0.210 () {66 vars in 1638 bytes} [Mon Nov 27 02:13:04 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8 => generated 302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG nova.compute.api [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:04 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:04 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-b35284eb-16fc-47ab-b754-b937ccb30f15 req-95162bee-9bd9-4918-80c0-c62d773a40fa tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8" status: 200 len: 302 microversion: 2.89 time: 0.087125 Nov 27 02:13:04 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 377/1139] 10.0.0.210 () {66 vars in 1638 bytes} [Mon Nov 27 02:13:04 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8 => generated 302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 02:13:05 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:05 user devstack@n-api.service[65192]: DEBUG nova.compute.api [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:05 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-75671c87-c2c5-456f-8f64-d5e43f978e5b req-057ec4d8-0e46-43bb-94ca-518ad840aec3 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8" status: 200 len: 302 microversion: 2.89 time: 0.089108 Nov 27 02:13:05 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 378/1140] 10.0.0.210 () {66 vars in 1638 bytes} [Mon Nov 27 02:13:05 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8 => generated 302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 02:13:05 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:05 user devstack@n-api.service[65194]: DEBUG nova.compute.api [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:05 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:05 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-771106ea-1363-4df4-8e37-d4bee5200e53 req-c3b19b11-ef6a-4a57-b80f-4dc9bdbe3b94 tempest-TestServerVolumeAttachmentScenario-371843487 tempest-TestServerVolumeAttachmentScenario-371843487-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8" status: 200 len: 302 microversion: 2.89 time: 0.098891 Nov 27 02:13:05 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 386/1141] 10.0.0.210 () {66 vars in 1638 bytes} [Mon Nov 27 02:13:05 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8 => generated 302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 27 02:13:05 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2341e579-340c-4f5c-97db-bc2d2b412e5c"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:05 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:05 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:06 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4f72a32c-8b3f-4d65-8f19-9462d87298fb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303842 Nov 27 02:13:06 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 378/1142] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:13:05 2023] POST /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1856724849", "imageRef": "01b1e412-ee92-4556-a47f-2bec3531815b", "flavorRef": "1", "key_name": "tempest-TestStampPattern-1519476636", "security_groups": [{"name": "tempest-secgroup-smoke-879619732"}], "networks": [{"uuid": "4e4d5d1d-7907-4b52-a20a-9fc221084d82"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] validate_networks() for [('4e4d5d1d-7907-4b52-a20a-9fc221084d82', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Getting quotas for project 198c6d978d68486fbcde872f4301619e. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Getting quotas for user 6feb3c5ea00745cd815858eec5d3f913 and project 198c6d978d68486fbcde872f4301619e. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:13:07 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='01b1e412-ee92-4556-a47f-2bec3531815b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:13:07 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-5f9c0cc7-5028-461c-a1f1-a9a87cd9ca7b tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.602616 Nov 27 02:13:07 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 379/1143] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:13:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 27 02:13:07 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f77d539f-cdc5-4b09-8a73-e3bb539fea66 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:07 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-f77d539f-cdc5-4b09-8a73-e3bb539fea66 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:08 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-f77d539f-cdc5-4b09-8a73-e3bb539fea66 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6feb3c5ea00745cd815858eec5d3f913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198c6d978d68486fbcde872f4301619e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:13:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-f77d539f-cdc5-4b09-8a73-e3bb539fea66 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1" status: 200 len: 1235 microversion: 2.1 time: 0.074807 Nov 27 02:13:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 387/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:13:07 2023] GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1 => generated 1235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:13:11 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-798334fc-c5cc-428a-a3c4-21108dd11bae req-5fcd7b40-5aa6-46cd-9ce5-d727d483bc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c66b306-1b9f-4e9e-b409-02fac1bde3e1", "tag": "b14b73a2-4cd4-4903-b1c5-1f891f70050c"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-798334fc-c5cc-428a-a3c4-21108dd11bae req-5fcd7b40-5aa6-46cd-9ce5-d727d483bc31 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-798334fc-c5cc-428a-a3c4-21108dd11bae req-5fcd7b40-5aa6-46cd-9ce5-d727d483bc31 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-798334fc-c5cc-428a-a3c4-21108dd11bae req-5fcd7b40-5aa6-46cd-9ce5-d727d483bc31 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-798334fc-c5cc-428a-a3c4-21108dd11bae req-5fcd7b40-5aa6-46cd-9ce5-d727d483bc31 service nova] Creating event network-changed:b14b73a2-4cd4-4903-b1c5-1f891f70050c for instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 on user Nov 27 02:13:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-798334fc-c5cc-428a-a3c4-21108dd11bae req-5fcd7b40-5aa6-46cd-9ce5-d727d483bc31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036750 Nov 27 02:13:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 379/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:13 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-8225193c-f6e2-4f28-a190-25f44250ba9c req-d876d654-8d0d-49ab-a0a0-d038d48286aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c66b306-1b9f-4e9e-b409-02fac1bde3e1", "name": "network-vif-plugged", "status": "completed", "tag": "b14b73a2-4cd4-4903-b1c5-1f891f70050c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8225193c-f6e2-4f28-a190-25f44250ba9c req-d876d654-8d0d-49ab-a0a0-d038d48286aa service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8225193c-f6e2-4f28-a190-25f44250ba9c req-d876d654-8d0d-49ab-a0a0-d038d48286aa service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:13 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8225193c-f6e2-4f28-a190-25f44250ba9c req-d876d654-8d0d-49ab-a0a0-d038d48286aa service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:13 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-8225193c-f6e2-4f28-a190-25f44250ba9c req-d876d654-8d0d-49ab-a0a0-d038d48286aa service nova] Creating event network-vif-plugged:b14b73a2-4cd4-4903-b1c5-1f891f70050c for instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 on user Nov 27 02:13:13 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-8225193c-f6e2-4f28-a190-25f44250ba9c req-d876d654-8d0d-49ab-a0a0-d038d48286aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Nov 27 02:13:13 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 380/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:13:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:15 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-8fe7cf31-929d-4b4c-92b9-e40fa2d41390 req-89f2984e-239e-4a17-88cf-fe42dd6d9be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c66b306-1b9f-4e9e-b409-02fac1bde3e1", "name": "network-vif-plugged", "status": "completed", "tag": "b14b73a2-4cd4-4903-b1c5-1f891f70050c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8fe7cf31-929d-4b4c-92b9-e40fa2d41390 req-89f2984e-239e-4a17-88cf-fe42dd6d9be7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8fe7cf31-929d-4b4c-92b9-e40fa2d41390 req-89f2984e-239e-4a17-88cf-fe42dd6d9be7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:15 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-8fe7cf31-929d-4b4c-92b9-e40fa2d41390 req-89f2984e-239e-4a17-88cf-fe42dd6d9be7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-8fe7cf31-929d-4b4c-92b9-e40fa2d41390 req-89f2984e-239e-4a17-88cf-fe42dd6d9be7 service nova] Creating event network-vif-plugged:b14b73a2-4cd4-4903-b1c5-1f891f70050c for instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 on user Nov 27 02:13:15 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-8fe7cf31-929d-4b4c-92b9-e40fa2d41390 req-89f2984e-239e-4a17-88cf-fe42dd6d9be7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037594 Nov 27 02:13:15 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 388/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:13:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:15 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:16 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lazy-loading 'services' on Instance uuid 24f9326a-e64f-4ffb-94a3-638019872d7a {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:13:16 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a848b47e-36fc-4a57-b7bf-5ac9f03034eb tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/2341e579-340c-4f5c-97db-bc2d2b412e5c" status: 202 len: 0 microversion: 2.1 time: 0.205911 Nov 27 02:13:16 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 380/1148] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:13:15 2023] DELETE /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/2341e579-340c-4f5c-97db-bc2d2b412e5c => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:13:16 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:16 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:16 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:16 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-362bd69a-a9e2-4d40-a342-a6d5dbb78b21 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048907 Nov 27 02:13:16 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 381/1149] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:13:16 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=24 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:33 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:34 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02f3b9aa7c4ff68b45cc6d749adb69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c461a06297740aa9f6f6f97d6ced545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:13:34 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4ccb1b6d-da31-4775-889d-1e3e693d2850 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 200 len: 1432 microversion: 2.1 time: 0.225932 Nov 27 02:13:34 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 389/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:13:33 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 1432 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:13:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-4634fb6e-3664-40a8-aa8f-c5e8f46e32c9 req-7081aa8d-310c-4eb5-8d00-9a1ed5ee7ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-4634fb6e-3664-40a8-aa8f-c5e8f46e32c9 req-7081aa8d-310c-4eb5-8d00-9a1ed5ee7ffa service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-4634fb6e-3664-40a8-aa8f-c5e8f46e32c9 req-7081aa8d-310c-4eb5-8d00-9a1ed5ee7ffa service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-4634fb6e-3664-40a8-aa8f-c5e8f46e32c9 req-7081aa8d-310c-4eb5-8d00-9a1ed5ee7ffa service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-4634fb6e-3664-40a8-aa8f-c5e8f46e32c9 req-7081aa8d-310c-4eb5-8d00-9a1ed5ee7ffa service nova] Creating event network-changed:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:13:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-4634fb6e-3664-40a8-aa8f-c5e8f46e32c9 req-7081aa8d-310c-4eb5-8d00-9a1ed5ee7ffa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038144 Nov 27 02:13:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 381/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:37 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lazy-loading 'flavor' on Instance uuid bef67b86-4e23-455c-9ea2-9a132f06e893 {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:13:37 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-171f5dcb-fe90-4b1f-8e42-6a8b16a9ad04 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893/action" status: 202 len: 0 microversion: 2.1 time: 0.115013 Nov 27 02:13:37 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 382/1152] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 02:13:37 2023] POST /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:37 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02f3b9aa7c4ff68b45cc6d749adb69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c461a06297740aa9f6f6f97d6ced545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:13:37 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3ed6579b-4ec9-4559-993d-f26805640b30 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 200 len: 1556 microversion: 2.1 time: 0.252540 Nov 27 02:13:37 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 390/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:13:37 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 1556 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:13:37 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-8fdba2de-956f-4df4-bef9-c794b995aed8 req-e821314d-19c1-41c6-b347-7c58f03042ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-unplugged", "status": "completed", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8fdba2de-956f-4df4-bef9-c794b995aed8 req-e821314d-19c1-41c6-b347-7c58f03042ce service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8fdba2de-956f-4df4-bef9-c794b995aed8 req-e821314d-19c1-41c6-b347-7c58f03042ce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:37 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8fdba2de-956f-4df4-bef9-c794b995aed8 req-e821314d-19c1-41c6-b347-7c58f03042ce service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:37 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8fdba2de-956f-4df4-bef9-c794b995aed8 req-e821314d-19c1-41c6-b347-7c58f03042ce service nova] Creating event network-vif-unplugged:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:13:37 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-8fdba2de-956f-4df4-bef9-c794b995aed8 req-e821314d-19c1-41c6-b347-7c58f03042ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034699 Nov 27 02:13:37 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 382/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:39 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-97298018-e55c-4a0f-b72e-d4a511ba7fdd req-41631655-33de-48d8-b7df-00ce47d3305f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-97298018-e55c-4a0f-b72e-d4a511ba7fdd req-41631655-33de-48d8-b7df-00ce47d3305f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-97298018-e55c-4a0f-b72e-d4a511ba7fdd req-41631655-33de-48d8-b7df-00ce47d3305f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-97298018-e55c-4a0f-b72e-d4a511ba7fdd req-41631655-33de-48d8-b7df-00ce47d3305f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-97298018-e55c-4a0f-b72e-d4a511ba7fdd req-41631655-33de-48d8-b7df-00ce47d3305f service nova] Creating event network-changed:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:13:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-97298018-e55c-4a0f-b72e-d4a511ba7fdd req-41631655-33de-48d8-b7df-00ce47d3305f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036757 Nov 27 02:13:39 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 383/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-59bcbd9f-1296-4754-9e8d-467c5ceac91e req-a9bb7ebf-3ef2-49fc-aaf9-02f2b5774a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-plugged", "status": "completed", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:13:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-59bcbd9f-1296-4754-9e8d-467c5ceac91e req-a9bb7ebf-3ef2-49fc-aaf9-02f2b5774a9c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-59bcbd9f-1296-4754-9e8d-467c5ceac91e req-a9bb7ebf-3ef2-49fc-aaf9-02f2b5774a9c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-59bcbd9f-1296-4754-9e8d-467c5ceac91e req-a9bb7ebf-3ef2-49fc-aaf9-02f2b5774a9c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-59bcbd9f-1296-4754-9e8d-467c5ceac91e req-a9bb7ebf-3ef2-49fc-aaf9-02f2b5774a9c service nova] Creating event network-vif-plugged:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:13:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-59bcbd9f-1296-4754-9e8d-467c5ceac91e req-a9bb7ebf-3ef2-49fc-aaf9-02f2b5774a9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039729 Nov 27 02:13:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 391/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:13:58 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6feb3c5ea00745cd815858eec5d3f913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198c6d978d68486fbcde872f4301619e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:13:58 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0ec50ab4-18e9-4145-8bb4-d0088a3d2606 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1" status: 200 len: 1536 microversion: 2.1 time: 0.218715 Nov 27 02:13:58 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 383/1157] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:13:58 2023] GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1 => generated 1536 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:06 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:06 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-388736ca-70e0-4b89-9ab2-4c7fbd26416b tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052179 Nov 27 02:14:06 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 384/1158] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:14:06 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=14 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:06 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lazy-loading 'services' on Instance uuid 24f9326a-e64f-4ffb-94a3-638019872d7a {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:14:06 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-cfeac87e-22e1-4515-87ea-e4c72fefebbd tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8" status: 202 len: 0 microversion: 2.1 time: 0.211645 Nov 27 02:14:06 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 392/1159] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:14:06 2023] DELETE /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:14:06 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:06 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:06 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:06 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-237ded95-f588-48d1-9393-6f4e9f794b63 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 Nov 27 02:14:06 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 384/1160] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:14:06 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:28 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02f3b9aa7c4ff68b45cc6d749adb69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c461a06297740aa9f6f6f97d6ced545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:14:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a43b4015-25cb-4664-a4f0-0867c6a6d45d tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 200 len: 1497 microversion: 2.1 time: 0.258014 Nov 27 02:14:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 385/1161] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:14:27 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:56 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3d62b7c4-87fe-4f87-8cf8-0e3e9ed5e53a tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053478 Nov 27 02:14:56 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 393/1162] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:14:56 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=12 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] HTTP exception thrown: Instance 24f9326a-e64f-4ffb-94a3-638019872d7a is not attached to volume 33fdd72a-77fe-4e8e-85f9-286c415f3ba8 Nov 27 02:14:56 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Returning 404 to user: Instance 24f9326a-e64f-4ffb-94a3-638019872d7a is not attached to volume 33fdd72a-77fe-4e8e-85f9-286c415f3ba8 {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:14:56 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-3d511ebe-5324-4d07-8a4c-413446ad998e tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8" status: 404 len: 154 microversion: 2.1 time: 0.106298 Nov 27 02:14:56 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 385/1163] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:14:56 2023] DELETE /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a/os-volume_attachments/33fdd72a-77fe-4e8e-85f9-286c415f3ba8 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:57 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:14:57 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4f59f4f8-78fa-4d85-83de-cc0476b205dc tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a" status: 204 len: 0 microversion: 2.1 time: 0.113177 Nov 27 02:14:57 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 386/1164] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:14:56 2023] DELETE /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:57 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288c914eb79447cdb47da5538bdbd80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afb522c8af24a3983c8f985fa83a3c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:14:57 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-f2da76cc-30c3-4c07-9999-2ca38cf9b5cd req-1afbf65a-349c-45dd-8f7c-ad39f1147b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f9326a-e64f-4ffb-94a3-638019872d7a", "name": "network-vif-unplugged", "status": "completed", "tag": "4f2044de-61d9-481e-82ed-0d0b5164eff0"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:14:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-7ada950d-6f1b-4fc2-b857-4c2ffe99ec76 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a" status: 200 len: 1688 microversion: 2.1 time: 0.223515 Nov 27 02:14:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 394/1165] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:14:57 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a => generated 1688 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:14:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f2da76cc-30c3-4c07-9999-2ca38cf9b5cd req-1afbf65a-349c-45dd-8f7c-ad39f1147b71 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f2da76cc-30c3-4c07-9999-2ca38cf9b5cd req-1afbf65a-349c-45dd-8f7c-ad39f1147b71 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:57 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-f2da76cc-30c3-4c07-9999-2ca38cf9b5cd req-1afbf65a-349c-45dd-8f7c-ad39f1147b71 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-f2da76cc-30c3-4c07-9999-2ca38cf9b5cd req-1afbf65a-349c-45dd-8f7c-ad39f1147b71 service nova] Creating event network-vif-unplugged:4f2044de-61d9-481e-82ed-0d0b5164eff0 for instance 24f9326a-e64f-4ffb-94a3-638019872d7a on user Nov 27 02:14:57 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-f2da76cc-30c3-4c07-9999-2ca38cf9b5cd req-1afbf65a-349c-45dd-8f7c-ad39f1147b71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032051 Nov 27 02:14:57 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 386/1166] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:14:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:58 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6feb3c5ea00745cd815858eec5d3f913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198c6d978d68486fbcde872f4301619e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:14:58 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-a6cad131-2f87-42b3-8797-2129a0d28272 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1" status: 200 len: 1536 microversion: 2.1 time: 0.226083 Nov 27 02:14:58 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 387/1167] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:14:58 2023] GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1 => generated 1536 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:14:59 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-3084e316-9446-4100-a608-7f7fb0c153cc req-71566ce7-ac11-4690-83dd-ce73e4a8b08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f9326a-e64f-4ffb-94a3-638019872d7a", "name": "network-vif-deleted", "tag": "4f2044de-61d9-481e-82ed-0d0b5164eff0"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:14:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3084e316-9446-4100-a608-7f7fb0c153cc req-71566ce7-ac11-4690-83dd-ce73e4a8b08c service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3084e316-9446-4100-a608-7f7fb0c153cc req-71566ce7-ac11-4690-83dd-ce73e4a8b08c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:59 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-3084e316-9446-4100-a608-7f7fb0c153cc req-71566ce7-ac11-4690-83dd-ce73e4a8b08c service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-3084e316-9446-4100-a608-7f7fb0c153cc req-71566ce7-ac11-4690-83dd-ce73e4a8b08c service nova] Creating event network-vif-deleted:4f2044de-61d9-481e-82ed-0d0b5164eff0 for instance 24f9326a-e64f-4ffb-94a3-638019872d7a on user Nov 27 02:14:59 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-3084e316-9446-4100-a608-7f7fb0c153cc req-71566ce7-ac11-4690-83dd-ce73e4a8b08c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032146 Nov 27 02:14:59 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 395/1168] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:14:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:14:59 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-7a6733da-c756-4fae-b57f-164dc24a8a44 req-5287ec10-94ec-45bf-aede-c4b67f7ba7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f9326a-e64f-4ffb-94a3-638019872d7a", "name": "network-vif-plugged", "status": "completed", "tag": "4f2044de-61d9-481e-82ed-0d0b5164eff0"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:14:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a6733da-c756-4fae-b57f-164dc24a8a44 req-5287ec10-94ec-45bf-aede-c4b67f7ba7f9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:14:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a6733da-c756-4fae-b57f-164dc24a8a44 req-5287ec10-94ec-45bf-aede-c4b67f7ba7f9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:14:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7a6733da-c756-4fae-b57f-164dc24a8a44 req-5287ec10-94ec-45bf-aede-c4b67f7ba7f9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:14:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7a6733da-c756-4fae-b57f-164dc24a8a44 req-5287ec10-94ec-45bf-aede-c4b67f7ba7f9 service nova] Creating event network-vif-plugged:4f2044de-61d9-481e-82ed-0d0b5164eff0 for instance 24f9326a-e64f-4ffb-94a3-638019872d7a on user Nov 27 02:14:59 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-7a6733da-c756-4fae-b57f-164dc24a8a44 req-5287ec10-94ec-45bf-aede-c4b67f7ba7f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030191 Nov 27 02:14:59 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 387/1169] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:14:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:15:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-337c955e-635b-4243-8ef4-be22cd46434f req-29d6553b-a5c5-46e1-904d-f55cf57421f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c66b306-1b9f-4e9e-b409-02fac1bde3e1", "tag": "b14b73a2-4cd4-4903-b1c5-1f891f70050c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:15:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-337c955e-635b-4243-8ef4-be22cd46434f req-29d6553b-a5c5-46e1-904d-f55cf57421f6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-337c955e-635b-4243-8ef4-be22cd46434f req-29d6553b-a5c5-46e1-904d-f55cf57421f6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-337c955e-635b-4243-8ef4-be22cd46434f req-29d6553b-a5c5-46e1-904d-f55cf57421f6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-337c955e-635b-4243-8ef4-be22cd46434f req-29d6553b-a5c5-46e1-904d-f55cf57421f6 service nova] Creating event network-changed:b14b73a2-4cd4-4903-b1c5-1f891f70050c for instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 on user Nov 27 02:15:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-337c955e-635b-4243-8ef4-be22cd46434f req-29d6553b-a5c5-46e1-904d-f55cf57421f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035722 Nov 27 02:15:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 388/1170] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:15:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:15:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c92959ab-0f99-46f9-abbd-392e84147566"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:15:00 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:15:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:01 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-9bdaa518-7322-4ba7-8bf5-69f994d2dba3 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284160 Nov 27 02:15:01 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 396/1171] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:15:00 2023] POST /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=10 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:10 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lazy-loading 'services' on Instance uuid 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:15:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-69acef6c-1f34-443a-a94c-bf9fff4c108d tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1/os-volume_attachments/c92959ab-0f99-46f9-abbd-392e84147566" status: 202 len: 0 microversion: 2.1 time: 0.235628 Nov 27 02:15:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 388/1172] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:15:10 2023] DELETE /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1/os-volume_attachments/c92959ab-0f99-46f9-abbd-392e84147566 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-8f460e4e-c169-461a-971e-72f3a8e73fd0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051155 Nov 27 02:15:11 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 389/1173] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:15:11 2023] GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=8 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:28 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65194) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 27 02:15:28 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6da93eee-783e-4f82-9f36-1e2f2210e17b tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893/action" status: 202 len: 0 microversion: 2.1 time: 0.126178 Nov 27 02:15:28 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 397/1174] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 02:15:28 2023] POST /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:28 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02f3b9aa7c4ff68b45cc6d749adb69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c461a06297740aa9f6f6f97d6ced545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:15:28 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-aeccba64-15d0-4c2b-858d-b87880fd46fd tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 200 len: 1505 microversion: 2.1 time: 0.233508 Nov 27 02:15:28 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 389/1175] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:15:28 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:15:38 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-21ff609d-12ff-4334-b301-f7186e457c2e req-6112ce53-eca7-44e7-a4e9-ffde64cac493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:15:38 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:38 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-21ff609d-12ff-4334-b301-f7186e457c2e req-6112ce53-eca7-44e7-a4e9-ffde64cac493 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-21ff609d-12ff-4334-b301-f7186e457c2e req-6112ce53-eca7-44e7-a4e9-ffde64cac493 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:38 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-21ff609d-12ff-4334-b301-f7186e457c2e req-6112ce53-eca7-44e7-a4e9-ffde64cac493 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:38 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-21ff609d-12ff-4334-b301-f7186e457c2e req-6112ce53-eca7-44e7-a4e9-ffde64cac493 service nova] Creating event network-changed:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:15:38 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-21ff609d-12ff-4334-b301-f7186e457c2e req-6112ce53-eca7-44e7-a4e9-ffde64cac493 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036908 Nov 27 02:15:38 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 390/1176] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:15:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:15:42 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:42 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:42 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d87e42f7-01de-4570-8f8a-4b44590ada2d req-08ebfcd4-6b7f-47c2-8ca7-c65922154953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-plugged", "status": "completed", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:15:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d87e42f7-01de-4570-8f8a-4b44590ada2d req-08ebfcd4-6b7f-47c2-8ca7-c65922154953 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d87e42f7-01de-4570-8f8a-4b44590ada2d req-08ebfcd4-6b7f-47c2-8ca7-c65922154953 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:42 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d87e42f7-01de-4570-8f8a-4b44590ada2d req-08ebfcd4-6b7f-47c2-8ca7-c65922154953 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d87e42f7-01de-4570-8f8a-4b44590ada2d req-08ebfcd4-6b7f-47c2-8ca7-c65922154953 service nova] Creating event network-vif-plugged:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:15:42 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d87e42f7-01de-4570-8f8a-4b44590ada2d req-08ebfcd4-6b7f-47c2-8ca7-c65922154953 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060082 Nov 27 02:15:42 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 398/1177] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:15:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:15:44 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-6ebe43d1-207b-442e-aff7-11846cacbcd1 req-07c73348-8c97-4c83-86f8-61191190009f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-plugged", "status": "completed", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:15:44 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:44 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:15:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6ebe43d1-207b-442e-aff7-11846cacbcd1 req-07c73348-8c97-4c83-86f8-61191190009f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6ebe43d1-207b-442e-aff7-11846cacbcd1 req-07c73348-8c97-4c83-86f8-61191190009f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:44 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-6ebe43d1-207b-442e-aff7-11846cacbcd1 req-07c73348-8c97-4c83-86f8-61191190009f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-6ebe43d1-207b-442e-aff7-11846cacbcd1 req-07c73348-8c97-4c83-86f8-61191190009f service nova] Creating event network-vif-plugged:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:15:44 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-6ebe43d1-207b-442e-aff7-11846cacbcd1 req-07c73348-8c97-4c83-86f8-61191190009f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033936 Nov 27 02:15:44 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 390/1178] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:15:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] [instance: 24f9326a-e64f-4ffb-94a3-638019872d7a] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:15:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] HTTP exception thrown: Instance 24f9326a-e64f-4ffb-94a3-638019872d7a could not be found. Nov 27 02:15:47 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Returning 404 to user: Instance 24f9326a-e64f-4ffb-94a3-638019872d7a could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:15:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4df578d7-7ca2-471c-ae0c-6af2a91ab9a0 tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a" status: 404 len: 111 microversion: 2.1 time: 0.030824 Nov 27 02:15:47 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 391/1179] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:15:47 2023] GET /compute/v2.1/servers/24f9326a-e64f-4ffb-94a3-638019872d7a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:15:47 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-c0fc6fe6-d36b-4246-a2e7-e2a4cebb67ae tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] Calling method '.version_select at 0x7f364af87640>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:15:47 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-c0fc6fe6-d36b-4246-a2e7-e2a4cebb67ae tempest-TestServerVolumeAttachmentScenario-899880160 tempest-TestServerVolumeAttachmentScenario-899880160-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888126627" status: 202 len: 0 microversion: 2.1 time: 0.023787 Nov 27 02:15:47 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 399/1180] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Nov 27 02:15:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888126627 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:01 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-b8242607-39fd-47a0-b6c4-a730f5e05549 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048889 Nov 27 02:16:01 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 391/1181] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:16:01 2023] GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:16:01 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:01 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:01 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-4acadce8-9ad5-4534-b2cf-0c871f028309 req-59996f90-a01f-4fe9-88f0-dc0b60beedcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c66b306-1b9f-4e9e-b409-02fac1bde3e1", "tag": "b14b73a2-4cd4-4903-b1c5-1f891f70050c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4acadce8-9ad5-4534-b2cf-0c871f028309 req-59996f90-a01f-4fe9-88f0-dc0b60beedcc service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4acadce8-9ad5-4534-b2cf-0c871f028309 req-59996f90-a01f-4fe9-88f0-dc0b60beedcc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4acadce8-9ad5-4534-b2cf-0c871f028309 req-59996f90-a01f-4fe9-88f0-dc0b60beedcc service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:01 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-4acadce8-9ad5-4534-b2cf-0c871f028309 req-59996f90-a01f-4fe9-88f0-dc0b60beedcc service nova] Creating event network-changed:b14b73a2-4cd4-4903-b1c5-1f891f70050c for instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 on user Nov 27 02:16:01 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-4acadce8-9ad5-4534-b2cf-0c871f028309 req-59996f90-a01f-4fe9-88f0-dc0b60beedcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036352 Nov 27 02:16:01 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 400/1182] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:16:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:16:01 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:16:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-f46edeca-d29c-4623-a303-27446bdfd5d2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1" status: 204 len: 0 microversion: 2.1 time: 0.142808 Nov 27 02:16:01 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 392/1183] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:16:01 2023] DELETE /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:01 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:02 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6feb3c5ea00745cd815858eec5d3f913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198c6d978d68486fbcde872f4301619e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:16:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-1523e866-758f-4842-b3e0-046098d63e32 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1" status: 200 len: 1660 microversion: 2.1 time: 0.307907 Nov 27 02:16:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 392/1184] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:16:01 2023] GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1 => generated 1660 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:16:03 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-fdcb39fa-b9e7-4dd6-add2-b0b771959d13 req-2820876c-ce4b-4fee-9c73-fb13bf0b4040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c66b306-1b9f-4e9e-b409-02fac1bde3e1", "name": "network-vif-deleted", "tag": "b14b73a2-4cd4-4903-b1c5-1f891f70050c"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:16:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-fdcb39fa-b9e7-4dd6-add2-b0b771959d13 req-2820876c-ce4b-4fee-9c73-fb13bf0b4040 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-fdcb39fa-b9e7-4dd6-add2-b0b771959d13 req-2820876c-ce4b-4fee-9c73-fb13bf0b4040 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-fdcb39fa-b9e7-4dd6-add2-b0b771959d13 req-2820876c-ce4b-4fee-9c73-fb13bf0b4040 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-fdcb39fa-b9e7-4dd6-add2-b0b771959d13 req-2820876c-ce4b-4fee-9c73-fb13bf0b4040 service nova] Creating event network-vif-deleted:b14b73a2-4cd4-4903-b1c5-1f891f70050c for instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 on user Nov 27 02:16:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-fdcb39fa-b9e7-4dd6-add2-b0b771959d13 req-2820876c-ce4b-4fee-9c73-fb13bf0b4040 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028427 Nov 27 02:16:03 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 401/1185] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:16:03 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-98be7702-4b0f-4315-8080-139a22811e49 req-461f25b6-e9d5-4bb8-b434-848a552449d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c66b306-1b9f-4e9e-b409-02fac1bde3e1", "name": "network-vif-unplugged", "status": "completed", "tag": "b14b73a2-4cd4-4903-b1c5-1f891f70050c"}, {"server_uuid": "5c66b306-1b9f-4e9e-b409-02fac1bde3e1", "name": "network-vif-plugged", "status": "completed", "tag": "b14b73a2-4cd4-4903-b1c5-1f891f70050c"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:16:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-98be7702-4b0f-4315-8080-139a22811e49 req-461f25b6-e9d5-4bb8-b434-848a552449d9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-98be7702-4b0f-4315-8080-139a22811e49 req-461f25b6-e9d5-4bb8-b434-848a552449d9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:03 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-98be7702-4b0f-4315-8080-139a22811e49 req-461f25b6-e9d5-4bb8-b434-848a552449d9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-98be7702-4b0f-4315-8080-139a22811e49 req-461f25b6-e9d5-4bb8-b434-848a552449d9 service nova] Creating event network-vif-unplugged:b14b73a2-4cd4-4903-b1c5-1f891f70050c for instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 on user Nov 27 02:16:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-98be7702-4b0f-4315-8080-139a22811e49 req-461f25b6-e9d5-4bb8-b434-848a552449d9 service nova] Creating event network-vif-plugged:b14b73a2-4cd4-4903-b1c5-1f891f70050c for instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 on user Nov 27 02:16:03 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-98be7702-4b0f-4315-8080-139a22811e49 req-461f25b6-e9d5-4bb8-b434-848a552449d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032037 Nov 27 02:16:03 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 393/1186] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:16:18 user devstack@n-api.service[65193]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=12 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:18 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02f3b9aa7c4ff68b45cc6d749adb69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c461a06297740aa9f6f6f97d6ced545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:16:18 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a25e7243-d488-466b-84e2-45c0e9c96f28 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 200 len: 1550 microversion: 2.1 time: 0.213909 Nov 27 02:16:18 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 393/1187] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:16:18 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 1550 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 5c66b306-1b9f-4e9e-b409-02fac1bde3e1] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] HTTP exception thrown: Instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 could not be found. Nov 27 02:16:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Returning 404 to user: Instance 5c66b306-1b9f-4e9e-b409-02fac1bde3e1 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:16:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d0e0b2f3-25aa-431c-b123-3365460708a7 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1" status: 404 len: 111 microversion: 2.1 time: 0.032716 Nov 27 02:16:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 402/1188] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:16:52 2023] GET /compute/v2.1/servers/5c66b306-1b9f-4e9e-b409-02fac1bde3e1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:16:58 user devstack@n-api.service[65192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:58 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] HTTP exception thrown: Instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 is not attached to volume 173c1eaf-8756-4f5b-91d0-1c9ac8353753 Nov 27 02:16:59 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Returning 404 to user: Instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 is not attached to volume 173c1eaf-8756-4f5b-91d0-1c9ac8353753 {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:16:59 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-99b6cf54-0048-477e-9cc1-5bfb819fe3fc tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments/173c1eaf-8756-4f5b-91d0-1c9ac8353753" status: 404 len: 154 microversion: 2.1 time: 0.254560 Nov 27 02:16:59 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 394/1189] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:16:58 2023] DELETE /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211/os-volume_attachments/173c1eaf-8756-4f5b-91d0-1c9ac8353753 => generated 154 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:16:59 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:16:59 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34808. Nov 27 02:17:00 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:17:00 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-55fde4b2-681b-43c8-bd62-aeac7a210d9b req-f889fc52-d8bf-4750-80cc-b70edaf57351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829426f9-7eb2-4ac2-a1b4-ab29eccdc211", "tag": "49152022-073e-4472-a5b5-d321dfc65eaf"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:17:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-55fde4b2-681b-43c8-bd62-aeac7a210d9b req-f889fc52-d8bf-4750-80cc-b70edaf57351 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-55fde4b2-681b-43c8-bd62-aeac7a210d9b req-f889fc52-d8bf-4750-80cc-b70edaf57351 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:00 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-55fde4b2-681b-43c8-bd62-aeac7a210d9b req-f889fc52-d8bf-4750-80cc-b70edaf57351 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-55fde4b2-681b-43c8-bd62-aeac7a210d9b req-f889fc52-d8bf-4750-80cc-b70edaf57351 service nova] Creating event network-changed:49152022-073e-4472-a5b5-d321dfc65eaf for instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 on user Nov 27 02:17:00 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-55fde4b2-681b-43c8-bd62-aeac7a210d9b req-f889fc52-d8bf-4750-80cc-b70edaf57351 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093277 Nov 27 02:17:00 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 403/1190] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:17:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-daff06a9-b0a9-4ca5-9bfc-bffee0670eed tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211" status: 204 len: 0 microversion: 2.1 time: 0.130924 Nov 27 02:17:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 394/1191] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:16:59 2023] DELETE /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:00 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34820. Nov 27 02:17:00 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6feb3c5ea00745cd815858eec5d3f913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198c6d978d68486fbcde872f4301619e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:17:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-35c3dc55-c97c-4853-982f-551bb151b0d0 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211" status: 200 len: 1660 microversion: 2.1 time: 0.308010 Nov 27 02:17:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 395/1192] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:17:00 2023] GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211 => generated 1660 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:17:01 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d09608fe-a467-4cbe-8bbd-9aaa7189d090 req-d78de3b8-422d-47d3-aa7f-3be495855399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829426f9-7eb2-4ac2-a1b4-ab29eccdc211", "name": "network-vif-unplugged", "status": "completed", "tag": "49152022-073e-4472-a5b5-d321dfc65eaf"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:17:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d09608fe-a467-4cbe-8bbd-9aaa7189d090 req-d78de3b8-422d-47d3-aa7f-3be495855399 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d09608fe-a467-4cbe-8bbd-9aaa7189d090 req-d78de3b8-422d-47d3-aa7f-3be495855399 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:01 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d09608fe-a467-4cbe-8bbd-9aaa7189d090 req-d78de3b8-422d-47d3-aa7f-3be495855399 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:01 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d09608fe-a467-4cbe-8bbd-9aaa7189d090 req-d78de3b8-422d-47d3-aa7f-3be495855399 service nova] Creating event network-vif-unplugged:49152022-073e-4472-a5b5-d321dfc65eaf for instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 on user Nov 27 02:17:01 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d09608fe-a467-4cbe-8bbd-9aaa7189d090 req-d78de3b8-422d-47d3-aa7f-3be495855399 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081207 Nov 27 02:17:01 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 404/1193] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:17:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:17:03 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-e9df9c93-9358-49f9-8359-10229f7c4346 req-167a46c0-4ec6-4fa6-b0f2-7bb978a3f326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829426f9-7eb2-4ac2-a1b4-ab29eccdc211", "name": "network-vif-plugged", "status": "completed", "tag": "49152022-073e-4472-a5b5-d321dfc65eaf"}, {"server_uuid": "829426f9-7eb2-4ac2-a1b4-ab29eccdc211", "name": "network-vif-deleted", "tag": "49152022-073e-4472-a5b5-d321dfc65eaf"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:17:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e9df9c93-9358-49f9-8359-10229f7c4346 req-167a46c0-4ec6-4fa6-b0f2-7bb978a3f326 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e9df9c93-9358-49f9-8359-10229f7c4346 req-167a46c0-4ec6-4fa6-b0f2-7bb978a3f326 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e9df9c93-9358-49f9-8359-10229f7c4346 req-167a46c0-4ec6-4fa6-b0f2-7bb978a3f326 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:03 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e9df9c93-9358-49f9-8359-10229f7c4346 req-167a46c0-4ec6-4fa6-b0f2-7bb978a3f326 service nova] Creating event network-vif-plugged:49152022-073e-4472-a5b5-d321dfc65eaf for instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 on user Nov 27 02:17:03 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e9df9c93-9358-49f9-8359-10229f7c4346 req-167a46c0-4ec6-4fa6-b0f2-7bb978a3f326 service nova] Creating event network-vif-deleted:49152022-073e-4472-a5b5-d321dfc65eaf for instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 on user Nov 27 02:17:03 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-e9df9c93-9358-49f9-8359-10229f7c4346 req-167a46c0-4ec6-4fa6-b0f2-7bb978a3f326 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032040 Nov 27 02:17:03 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 395/1194] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:17:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=12 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:19 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:19 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:19 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:17:19 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-6b283643-0240-4efc-96ea-b6e332e0eee1 req-7b040858-304d-46cb-863e-1802930ccbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:17:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6b283643-0240-4efc-96ea-b6e332e0eee1 req-7b040858-304d-46cb-863e-1802930ccbe2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6b283643-0240-4efc-96ea-b6e332e0eee1 req-7b040858-304d-46cb-863e-1802930ccbe2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-6b283643-0240-4efc-96ea-b6e332e0eee1 req-7b040858-304d-46cb-863e-1802930ccbe2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-6b283643-0240-4efc-96ea-b6e332e0eee1 req-7b040858-304d-46cb-863e-1802930ccbe2 service nova] Creating event network-changed:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:17:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-6b283643-0240-4efc-96ea-b6e332e0eee1 req-7b040858-304d-46cb-863e-1802930ccbe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105191 Nov 27 02:17:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 405/1195] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:17:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-722ba4d6-389e-4ae7-b4a9-ae097529407e tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 204 len: 0 microversion: 2.1 time: 0.122459 Nov 27 02:17:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 396/1196] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:17:19 2023] DELETE /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-5da434b5-4305-4f56-94a3-c2f473f61825 req-14c6bbb1-76a3-4557-8705-f2ce95f4ecc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-unplugged", "status": "completed", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:17:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5da434b5-4305-4f56-94a3-c2f473f61825 req-14c6bbb1-76a3-4557-8705-f2ce95f4ecc1 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5da434b5-4305-4f56-94a3-c2f473f61825 req-14c6bbb1-76a3-4557-8705-f2ce95f4ecc1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5da434b5-4305-4f56-94a3-c2f473f61825 req-14c6bbb1-76a3-4557-8705-f2ce95f4ecc1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-5da434b5-4305-4f56-94a3-c2f473f61825 req-14c6bbb1-76a3-4557-8705-f2ce95f4ecc1 service nova] Creating event network-vif-unplugged:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:17:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-5da434b5-4305-4f56-94a3-c2f473f61825 req-14c6bbb1-76a3-4557-8705-f2ce95f4ecc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027790 Nov 27 02:17:20 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 406/1197] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:17:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:17:20 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd02f3b9aa7c4ff68b45cc6d749adb69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c461a06297740aa9f6f6f97d6ced545', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:17:20 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ec03fe81-6ee6-45b5-93bb-866634e7bbe5 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 200 len: 1556 microversion: 2.1 time: 0.387872 Nov 27 02:17:20 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 396/1198] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:17:19 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 1556 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:17:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-a537dbd4-3e10-487f-942b-090abd484077 req-1f471eb7-0ea8-4b99-a856-bfbe3846f8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-deleted", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:17:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a537dbd4-3e10-487f-942b-090abd484077 req-1f471eb7-0ea8-4b99-a856-bfbe3846f8f1 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a537dbd4-3e10-487f-942b-090abd484077 req-1f471eb7-0ea8-4b99-a856-bfbe3846f8f1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a537dbd4-3e10-487f-942b-090abd484077 req-1f471eb7-0ea8-4b99-a856-bfbe3846f8f1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-a537dbd4-3e10-487f-942b-090abd484077 req-1f471eb7-0ea8-4b99-a856-bfbe3846f8f1 service nova] Creating event network-vif-deleted:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:17:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-a537dbd4-3e10-487f-942b-090abd484077 req-1f471eb7-0ea8-4b99-a856-bfbe3846f8f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033533 Nov 27 02:17:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 397/1199] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:17:22 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-b6843de4-531a-47e2-9019-fab9a0aa958d req-ac71d5fc-76d0-40fa-9b08-6188725e8c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef67b86-4e23-455c-9ea2-9a132f06e893", "name": "network-vif-plugged", "status": "completed", "tag": "22e7fdc5-00a6-4e47-b3a8-facd0088148b"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:17:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b6843de4-531a-47e2-9019-fab9a0aa958d req-ac71d5fc-76d0-40fa-9b08-6188725e8c4d service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b6843de4-531a-47e2-9019-fab9a0aa958d req-ac71d5fc-76d0-40fa-9b08-6188725e8c4d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:22 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b6843de4-531a-47e2-9019-fab9a0aa958d req-ac71d5fc-76d0-40fa-9b08-6188725e8c4d service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-b6843de4-531a-47e2-9019-fab9a0aa958d req-ac71d5fc-76d0-40fa-9b08-6188725e8c4d service nova] Creating event network-vif-plugged:22e7fdc5-00a6-4e47-b3a8-facd0088148b for instance bef67b86-4e23-455c-9ea2-9a132f06e893 on user Nov 27 02:17:22 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-b6843de4-531a-47e2-9019-fab9a0aa958d req-ac71d5fc-76d0-40fa-9b08-6188725e8c4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030476 Nov 27 02:17:22 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 407/1200] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:17:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] [instance: 829426f9-7eb2-4ac2-a1b4-ab29eccdc211] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:17:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] HTTP exception thrown: Instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 could not be found. Nov 27 02:17:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Returning 404 to user: Instance 829426f9-7eb2-4ac2-a1b4-ab29eccdc211 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:17:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-ccc85019-7a06-4298-b320-92af66be2dd2 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211" status: 404 len: 111 microversion: 2.1 time: 0.031240 Nov 27 02:17:50 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 397/1201] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:17:50 2023] GET /compute/v2.1/servers/829426f9-7eb2-4ac2-a1b4-ab29eccdc211 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:17:54 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:54 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:17:54 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e9efeacc-d33e-49d2-a099-baf4af712634 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] Calling method '.version_select at 0x7f364ae5b2e0>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:17:54 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e9efeacc-d33e-49d2-a099-baf4af712634 tempest-TestStampPattern-781941624 tempest-TestStampPattern-781941624-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1519476636" status: 202 len: 0 microversion: 2.1 time: 0.033988 Nov 27 02:17:54 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 398/1202] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Nov 27 02:17:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1519476636 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] [instance: bef67b86-4e23-455c-9ea2-9a132f06e893] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:18:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] HTTP exception thrown: Instance bef67b86-4e23-455c-9ea2-9a132f06e893 could not be found. Nov 27 02:18:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Returning 404 to user: Instance bef67b86-4e23-455c-9ea2-9a132f06e893 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:18:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e6a6cf31-a262-4a6f-9b61-dca1f87cfec7 tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893" status: 404 len: 111 microversion: 2.1 time: 0.036098 Nov 27 02:18:10 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 408/1203] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:18:10 2023] GET /compute/v2.1/servers/bef67b86-4e23-455c-9ea2-9a132f06e893 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:18:10 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-b7218875-5cc3-4c4e-a84d-95f797ad4f4a tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] Calling method '.version_select at 0x7f364b138820>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:18:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-b7218875-5cc3-4c4e-a84d-95f797ad4f4a tempest-TestShelveInstance-2079622152 tempest-TestShelveInstance-2079622152-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1339359276" status: 202 len: 0 microversion: 2.1 time: 0.029846 Nov 27 02:18:10 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 398/1204] 10.0.0.210 () {62 vars in 1331 bytes} [Mon Nov 27 02:18:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1339359276 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:18:38 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:18:38 user devstack@n-api.service[65192]: Mon Nov 27 02:18:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 27 02:18:38 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:38 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-122188712", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "b15133ce-bbe7-4f9c-82a3-234b06904bf8", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "675bf9c2-df4c-4902-aca4-7b7df68322da"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] validate_networks() for [('675bf9c2-df4c-4902-aca4-7b7df68322da', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:18:39 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b15133ce-bbe7-4f9c-82a3-234b06904bf8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:18:39 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ab4784c1-6f6e-450d-b168-b17d4523ae30 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.671131 Nov 27 02:18:39 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 399/1205] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:18:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:18:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-cfe1ff20-44b5-4434-b6bc-13e4d3a4287d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:18:39 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-cfe1ff20-44b5-4434-b6bc-13e4d3a4287d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:18:39 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:39 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:39 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-cfe1ff20-44b5-4434-b6bc-13e4d3a4287d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:18:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-cfe1ff20-44b5-4434-b6bc-13e4d3a4287d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 200 len: 1049 microversion: 2.1 time: 0.309087 Nov 27 02:18:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 409/1206] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:18:39 2023] GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 1049 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 02:18:41 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:41 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-8d0e3066-12f8-46e4-9d33-05d1c43ffd3e req-1aea5472-a176-4dc7-8697-811e3d5e6904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:18:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8d0e3066-12f8-46e4-9d33-05d1c43ffd3e req-1aea5472-a176-4dc7-8697-811e3d5e6904 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:18:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8d0e3066-12f8-46e4-9d33-05d1c43ffd3e req-1aea5472-a176-4dc7-8697-811e3d5e6904 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:18:41 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-8d0e3066-12f8-46e4-9d33-05d1c43ffd3e req-1aea5472-a176-4dc7-8697-811e3d5e6904 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:18:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-8d0e3066-12f8-46e4-9d33-05d1c43ffd3e req-1aea5472-a176-4dc7-8697-811e3d5e6904 service nova] Creating event network-changed:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:18:41 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-8d0e3066-12f8-46e4-9d33-05d1c43ffd3e req-1aea5472-a176-4dc7-8697-811e3d5e6904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035849 Nov 27 02:18:41 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 399/1207] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:18:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:18:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-bc33a617-41cb-4114-a684-c64e69edffe7 req-3b791705-940f-4a14-91d1-f76c562f1447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-plugged", "status": "completed", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:18:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:55 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bc33a617-41cb-4114-a684-c64e69edffe7 req-3b791705-940f-4a14-91d1-f76c562f1447 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:18:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bc33a617-41cb-4114-a684-c64e69edffe7 req-3b791705-940f-4a14-91d1-f76c562f1447 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:18:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bc33a617-41cb-4114-a684-c64e69edffe7 req-3b791705-940f-4a14-91d1-f76c562f1447 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:18:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-bc33a617-41cb-4114-a684-c64e69edffe7 req-3b791705-940f-4a14-91d1-f76c562f1447 service nova] Creating event network-vif-plugged:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:18:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-bc33a617-41cb-4114-a684-c64e69edffe7 req-3b791705-940f-4a14-91d1-f76c562f1447 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040928 Nov 27 02:18:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 400/1208] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:18:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-1e4240ce-0d95-4580-9501-9fcab41326ce req-60b9fed3-838c-427d-9e83-d740e8f289d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-plugged", "status": "completed", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:18:57 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:57 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:18:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-1e4240ce-0d95-4580-9501-9fcab41326ce req-60b9fed3-838c-427d-9e83-d740e8f289d7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:18:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-1e4240ce-0d95-4580-9501-9fcab41326ce req-60b9fed3-838c-427d-9e83-d740e8f289d7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:18:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-1e4240ce-0d95-4580-9501-9fcab41326ce req-60b9fed3-838c-427d-9e83-d740e8f289d7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:18:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-1e4240ce-0d95-4580-9501-9fcab41326ce req-60b9fed3-838c-427d-9e83-d740e8f289d7 service nova] Creating event network-vif-plugged:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:18:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-1e4240ce-0d95-4580-9501-9fcab41326ce req-60b9fed3-838c-427d-9e83-d740e8f289d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033367 Nov 27 02:18:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 410/1209] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:18:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:19:30 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:19:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-416f9a47-970d-4db4-a931-cbd8b8aca15a tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 200 len: 1376 microversion: 2.1 time: 0.231869 Nov 27 02:19:30 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 400/1210] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:19:30 2023] GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 1376 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:20:30 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:20:30 user devstack@n-api.service[65192]: Mon Nov 27 02:20:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 (ip 10.0.0.210) !!! Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:30 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:20:30 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-4ac8918b-9c21-4a0b-86de-824e50fc0c1d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 200 len: 1376 microversion: 2.1 time: 0.229642 Nov 27 02:20:30 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 401/1211] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:20:30 2023] GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 1376 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:20:30 user devstack@n-api.service[65194]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d93a33c4-2c4a-4e51-984a-1d3906e48e4f] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:20:30 user devstack@n-api.service[65194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:20:30 user devstack@n-api.service[65194]: Mon Nov 27 02:20:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 (ip 10.0.0.210) !!! Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:30 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:20:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-5df58062-90ec-45ce-8839-1f76dadb0a84 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 200 len: 1376 microversion: 2.1 time: 0.219182 Nov 27 02:20:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 411/1212] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:20:30 2023] GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 1376 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:20:30 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:20:30 user devstack@n-api.service[65193]: Mon Nov 27 02:20:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 (ip 10.0.0.210) !!! Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:30 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:20:31 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7c087be4-709c-4975-93ee-a04122473570 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 204 len: 0 microversion: 2.1 time: 0.126360 Nov 27 02:20:31 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 401/1213] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:20:30 2023] DELETE /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:31 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:20:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3eb24953-8c72-4069-866e-c3c9e552f8a6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 200 len: 1382 microversion: 2.1 time: 0.187445 Nov 27 02:20:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 402/1214] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:20:31 2023] GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 1382 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:20:31 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-4de2e152-831c-4b9f-825d-676a4e38fe4e req-81b6dae6-2bfe-42f1-8c72-c8586e058713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-unplugged", "status": "completed", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:20:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4de2e152-831c-4b9f-825d-676a4e38fe4e req-81b6dae6-2bfe-42f1-8c72-c8586e058713 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4de2e152-831c-4b9f-825d-676a4e38fe4e req-81b6dae6-2bfe-42f1-8c72-c8586e058713 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:31 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4de2e152-831c-4b9f-825d-676a4e38fe4e req-81b6dae6-2bfe-42f1-8c72-c8586e058713 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-4de2e152-831c-4b9f-825d-676a4e38fe4e req-81b6dae6-2bfe-42f1-8c72-c8586e058713 service nova] Creating event network-vif-unplugged:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:20:31 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-4de2e152-831c-4b9f-825d-676a4e38fe4e req-81b6dae6-2bfe-42f1-8c72-c8586e058713 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029684 Nov 27 02:20:31 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 412/1215] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:20:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:20:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-c2655e4f-3dbe-4e94-a27b-015b9e1f86d6 req-22f98404-c83d-4c86-aebd-d109314dfb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-deleted", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:20:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c2655e4f-3dbe-4e94-a27b-015b9e1f86d6 req-22f98404-c83d-4c86-aebd-d109314dfb45 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c2655e4f-3dbe-4e94-a27b-015b9e1f86d6 req-22f98404-c83d-4c86-aebd-d109314dfb45 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:33 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-c2655e4f-3dbe-4e94-a27b-015b9e1f86d6 req-22f98404-c83d-4c86-aebd-d109314dfb45 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-c2655e4f-3dbe-4e94-a27b-015b9e1f86d6 req-22f98404-c83d-4c86-aebd-d109314dfb45 service nova] Creating event network-vif-deleted:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:20:33 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-plugged", "status": "completed", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}, {"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-plugged", "status": "completed", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}, {"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-plugged", "status": "completed", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}, {"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-unplugged", "status": "completed", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}, {"server_uuid": "6ba58ba5-00e7-4aa5-8489-c71830d21306", "name": "network-vif-plugged", "status": "completed", "tag": "526d22ae-c492-4157-a1d8-5476b50e352e"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:20:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-c2655e4f-3dbe-4e94-a27b-015b9e1f86d6 req-22f98404-c83d-4c86-aebd-d109314dfb45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032966 Nov 27 02:20:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 402/1216] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:20:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:20:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:20:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:20:33 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:20:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Creating event network-vif-plugged:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:20:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Creating event network-vif-plugged:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:20:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Creating event network-vif-plugged:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:20:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Creating event network-vif-unplugged:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:20:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] Creating event network-vif-plugged:526d22ae-c492-4157-a1d8-5476b50e352e for instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 on user Nov 27 02:20:33 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-bf8c367e-8795-4a83-ba76-9dddaadbdbac req-612a48a8-640f-40e0-98c9-b7e336850757 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031805 Nov 27 02:20:33 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 403/1217] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:20:33 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=8 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 could not be found. Nov 27 02:21:21 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:21:21 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-17702db9-6f45-410f-9c8b-a08b9533c48e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 404 len: 111 microversion: 2.1 time: 0.039529 Nov 27 02:21:21 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 413/1218] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:21:21 2023] GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:21:21 user devstack@n-api.service[65193]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:21 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 could not be found. Nov 27 02:21:21 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:21:21 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-43515dc5-9d03-4646-9f6b-b5b522c84454 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 404 len: 111 microversion: 2.1 time: 0.037507 Nov 27 02:21:21 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 403/1219] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:21:21 2023] DELETE /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=14 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 6ba58ba5-00e7-4aa5-8489-c71830d21306] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 could not be found. Nov 27 02:21:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance 6ba58ba5-00e7-4aa5-8489-c71830d21306 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:21:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-351921b3-521f-4060-b7c7-fb56971c00d5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306" status: 404 len: 111 microversion: 2.1 time: 0.033484 Nov 27 02:21:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 404/1220] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:21:21 2023] GET /compute/v2.1/servers/6ba58ba5-00e7-4aa5-8489-c71830d21306 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:21:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0d5bb910-32ab-47f8-8a90-2c281f8bbc0c tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: .version_select at 0x7f364afb04c0>, body: {"keypair": {"name": "tempest-keypair-250614271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMr8VZgfLODxBvAUFk70svfTMHZ3NEYpooGwEOs4t/IvdcoRcCqOoZAvEH9w7fW9k1VYjq2+ROBGmrpFvkU5KN6sxcXBikITk7KYgbo3WntHQ7H3Rkgc1hMlbf/3zFDbA=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:21:32 user devstack@n-api.service[65194]: INFO oslo.messaging._drivers.impl_rabbit [-] [d93a33c4-2c4a-4e51-984a-1d3906e48e4f] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47706. Nov 27 02:21:32 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:32 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:32 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-0d5bb910-32ab-47f8-8a90-2c281f8bbc0c tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:21:32 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-0d5bb910-32ab-47f8-8a90-2c281f8bbc0c tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:21:32 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0d5bb910-32ab-47f8-8a90-2c281f8bbc0c tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061947 Nov 27 02:21:32 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 414/1221] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:21:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:21:34 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-965272070", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "641aa6c5-b46a-43b2-80da-76b884496890", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "675bf9c2-df4c-4902-aca4-7b7df68322da"}], "security_groups": [{"name": "tempest-securitygroup--422092671"}], "key_name": "tempest-keypair-250614271", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:21:34 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:34 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:34 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 53806. Nov 27 02:21:34 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] validate_networks() for [('675bf9c2-df4c-4902-aca4-7b7df68322da', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:21:35 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='641aa6c5-b46a-43b2-80da-76b884496890',volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:21:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a4b6019c-d5e3-4293-a458-69292a9fe9ba tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.405809 Nov 27 02:21:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 404/1222] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:21:34 2023] POST /compute/v2.1/servers => generated 403 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:21:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-7c8c2ed1-c381-4835-a6a1-bea5113e201d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:21:35 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-7c8c2ed1-c381-4835-a6a1-bea5113e201d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:21:35 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:35 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:35 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-7c8c2ed1-c381-4835-a6a1-bea5113e201d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:21:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-7c8c2ed1-c381-4835-a6a1-bea5113e201d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce" status: 200 len: 1086 microversion: 2.1 time: 0.080433 Nov 27 02:21:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 405/1223] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:21:35 2023] GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce => generated 1086 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:21:37 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-b99ece6a-c655-46d0-9e98-f2050dc5b5b9 req-0d5e9c4c-6c5e-4092-883f-a7057c2b29d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3cdd24-fb6c-4e14-b310-4149812d1fce", "tag": "574f4dee-3e45-4319-8a47-3443eb7da829"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:21:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b99ece6a-c655-46d0-9e98-f2050dc5b5b9 req-0d5e9c4c-6c5e-4092-883f-a7057c2b29d7 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b99ece6a-c655-46d0-9e98-f2050dc5b5b9 req-0d5e9c4c-6c5e-4092-883f-a7057c2b29d7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:37 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b99ece6a-c655-46d0-9e98-f2050dc5b5b9 req-0d5e9c4c-6c5e-4092-883f-a7057c2b29d7 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:37 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-b99ece6a-c655-46d0-9e98-f2050dc5b5b9 req-0d5e9c4c-6c5e-4092-883f-a7057c2b29d7 service nova] Creating event network-changed:574f4dee-3e45-4319-8a47-3443eb7da829 for instance ca3cdd24-fb6c-4e14-b310-4149812d1fce on user Nov 27 02:21:37 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-b99ece6a-c655-46d0-9e98-f2050dc5b5b9 req-0d5e9c4c-6c5e-4092-883f-a7057c2b29d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033290 Nov 27 02:21:37 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 415/1224] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:21:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-e796e1fc-dcfb-4c3d-8187-6f4e9b0ad0f8 req-23c62b34-2fed-4d8a-8217-834d979845d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3cdd24-fb6c-4e14-b310-4149812d1fce", "name": "network-vif-plugged", "status": "completed", "tag": "574f4dee-3e45-4319-8a47-3443eb7da829"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:21:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e796e1fc-dcfb-4c3d-8187-6f4e9b0ad0f8 req-23c62b34-2fed-4d8a-8217-834d979845d0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e796e1fc-dcfb-4c3d-8187-6f4e9b0ad0f8 req-23c62b34-2fed-4d8a-8217-834d979845d0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-e796e1fc-dcfb-4c3d-8187-6f4e9b0ad0f8 req-23c62b34-2fed-4d8a-8217-834d979845d0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-e796e1fc-dcfb-4c3d-8187-6f4e9b0ad0f8 req-23c62b34-2fed-4d8a-8217-834d979845d0 service nova] Creating event network-vif-plugged:574f4dee-3e45-4319-8a47-3443eb7da829 for instance ca3cdd24-fb6c-4e14-b310-4149812d1fce on user Nov 27 02:21:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-e796e1fc-dcfb-4c3d-8187-6f4e9b0ad0f8 req-23c62b34-2fed-4d8a-8217-834d979845d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068633 Nov 27 02:21:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 405/1225] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:21:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:21:47 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-861ea0eb-375c-4ba9-9f2d-1f75619488b2 req-7fb26106-4c0c-471e-8ab2-cbba90369311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3cdd24-fb6c-4e14-b310-4149812d1fce", "name": "network-vif-plugged", "status": "completed", "tag": "574f4dee-3e45-4319-8a47-3443eb7da829"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:21:47 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:47 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:21:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-861ea0eb-375c-4ba9-9f2d-1f75619488b2 req-7fb26106-4c0c-471e-8ab2-cbba90369311 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:21:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-861ea0eb-375c-4ba9-9f2d-1f75619488b2 req-7fb26106-4c0c-471e-8ab2-cbba90369311 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:21:47 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-861ea0eb-375c-4ba9-9f2d-1f75619488b2 req-7fb26106-4c0c-471e-8ab2-cbba90369311 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:21:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-861ea0eb-375c-4ba9-9f2d-1f75619488b2 req-7fb26106-4c0c-471e-8ab2-cbba90369311 service nova] Creating event network-vif-plugged:574f4dee-3e45-4319-8a47-3443eb7da829 for instance ca3cdd24-fb6c-4e14-b310-4149812d1fce on user Nov 27 02:21:47 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-861ea0eb-375c-4ba9-9f2d-1f75619488b2 req-7fb26106-4c0c-471e-8ab2-cbba90369311 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035061 Nov 27 02:21:47 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 406/1226] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:21:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:22:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:22:26 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:22:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-43deb9a2-b7e7-4c9f-bd55-47094972d88d tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce" status: 200 len: 1438 microversion: 2.1 time: 0.213471 Nov 27 02:22:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 416/1227] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:22:25 2023] GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce => generated 1438 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:23:26 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:23:26 user devstack@n-api.service[65193]: Mon Nov 27 02:23:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce/os-interface (ip 10.0.0.210) !!! Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:26 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:26 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9121fc5b-79bd-4c3f-bc72-72cbb85d4974 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.164843 Nov 27 02:23:26 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 406/1228] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:23:26 2023] GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce/os-interface => generated 282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:23:26 user devstack@n-api.service[65192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:23:26 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:23:26 user devstack@n-api.service[65192]: Mon Nov 27 02:23:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 27 02:23:26 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:26 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:27 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-85d382d1-8f28-4a0d-9232-fd86e88e0fcc req-8b0c696a-7bd4-4e84-9220-2cf35f3c56f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3cdd24-fb6c-4e14-b310-4149812d1fce", "tag": "574f4dee-3e45-4319-8a47-3443eb7da829"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:23:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-85d382d1-8f28-4a0d-9232-fd86e88e0fcc req-8b0c696a-7bd4-4e84-9220-2cf35f3c56f4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-85d382d1-8f28-4a0d-9232-fd86e88e0fcc req-8b0c696a-7bd4-4e84-9220-2cf35f3c56f4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:27 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-85d382d1-8f28-4a0d-9232-fd86e88e0fcc req-8b0c696a-7bd4-4e84-9220-2cf35f3c56f4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-85d382d1-8f28-4a0d-9232-fd86e88e0fcc req-8b0c696a-7bd4-4e84-9220-2cf35f3c56f4 service nova] Creating event network-changed:574f4dee-3e45-4319-8a47-3443eb7da829 for instance ca3cdd24-fb6c-4e14-b310-4149812d1fce on user Nov 27 02:23:27 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-85d382d1-8f28-4a0d-9232-fd86e88e0fcc req-8b0c696a-7bd4-4e84-9220-2cf35f3c56f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100964 Nov 27 02:23:27 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 407/1229] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:23:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:27 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:23:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-29aedc2b-495c-47bd-abd5-313638559e4e tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce" status: 200 len: 1438 microversion: 2.1 time: 0.155713 Nov 27 02:23:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 417/1230] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:23:27 2023] GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce => generated 1438 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-621746319"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:27 user devstack@n-api.service[65193]: INFO nova.compute.api [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Attempting to quiesce instance before volume snapshot. Nov 27 02:23:27 user devstack@n-api.service[65193]: INFO nova.compute.api [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 27 02:23:27 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Creating snapshot from volume 641aa6c5-b46a-43b2-80da-76b884496890. {{(pid=65193) snapshot_instance /opt/stack/nova/nova/compute/api.py:3512}} Nov 27 02:23:29 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-9bab4ba6-4c14-4942-a360-478677f35efd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce/action" status: 202 len: 0 microversion: 2.1 time: 2.563175 Nov 27 02:23:29 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 407/1231] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Nov 27 02:23:27 2023] POST /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce/action => generated 0 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 27 02:23:31 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60040. Nov 27 02:23:31 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-d0252aeb-8b6f-4ae4-b130-5a11ef8316f4 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: .version_select at 0x7f364aeb6b90>, body: {"keypair": {"name": "tempest-keypair-490804150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4uS7M4SCNhnG3Idzj/uB/cvdV7Av0HxAwnNWxNT9oc5aMtSCtcfhmhxCDSlNllKVFy4dk5iLuGk7GKFX+H/7UzyjzUfSv6g5l+s3WGymP4doo2O69Bskq/3SLc+9rVXQ=="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:23:31 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-d0252aeb-8b6f-4ae4-b130-5a11ef8316f4 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:23:31 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-d0252aeb-8b6f-4ae4-b130-5a11ef8316f4 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'key_pairs'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:23:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-d0252aeb-8b6f-4ae4-b130-5a11ef8316f4 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102924 Nov 27 02:23:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 408/1232] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:23:31 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-751337736", "imageRef": "a2e5a4c2-b228-4373-956a-dd48c4758b4d", "flavorRef": "1", "networks": [{"uuid": "675bf9c2-df4c-4902-aca4-7b7df68322da"}], "security_groups": [{"name": "tempest-securitygroup--351685916"}], "key_name": "tempest-keypair-490804150", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.network.neutron [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] validate_networks() for [('675bf9c2-df4c-4902-aca4-7b7df68322da', None, None, None, None, None)] {{(pid=65194) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image limits 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image pref 0:0:0 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.virt.hardware [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Going to run 1 instances... {{(pid=65194) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:23:32 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='47da5221-b074-42cf-a57d-7972d77a0bb4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:23:33 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-37984416-80f1-48c1-ac18-2c86be478d71 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.689644 Nov 27 02:23:33 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 418/1233] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:23:32 2023] POST /compute/v2.1/servers => generated 403 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:23:33 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-7659a050-36fe-4b62-b542-b3e203c4333b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:23:33 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-7659a050-36fe-4b62-b542-b3e203c4333b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:23:33 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-7659a050-36fe-4b62-b542-b3e203c4333b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:23:33 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-7659a050-36fe-4b62-b542-b3e203c4333b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f" status: 200 len: 1244 microversion: 2.1 time: 0.073592 Nov 27 02:23:33 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 408/1234] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:23:33 2023] GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f => generated 1244 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:23:35 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-8689479e-330d-405b-9093-dbbd1afff2ab req-fe59af9a-98eb-44da-b2ec-163ab6a493b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb2449f1-ce09-4518-9ed0-d91d34b0d92f", "tag": "2cb6fa8f-49a1-4c53-909c-8ac838368973"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:23:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8689479e-330d-405b-9093-dbbd1afff2ab req-fe59af9a-98eb-44da-b2ec-163ab6a493b0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8689479e-330d-405b-9093-dbbd1afff2ab req-fe59af9a-98eb-44da-b2ec-163ab6a493b0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-8689479e-330d-405b-9093-dbbd1afff2ab req-fe59af9a-98eb-44da-b2ec-163ab6a493b0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-8689479e-330d-405b-9093-dbbd1afff2ab req-fe59af9a-98eb-44da-b2ec-163ab6a493b0 service nova] Creating event network-changed:2cb6fa8f-49a1-4c53-909c-8ac838368973 for instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f on user Nov 27 02:23:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-8689479e-330d-405b-9093-dbbd1afff2ab req-fe59af9a-98eb-44da-b2ec-163ab6a493b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033154 Nov 27 02:23:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 409/1235] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:23:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:23:48 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:48 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=8 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:48 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:48 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:48 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-659975cd-9259-4f96-b73c-ab36e3687681 req-6c5d534d-9d82-48da-9972-0baef93e33bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2449f1-ce09-4518-9ed0-d91d34b0d92f", "name": "network-vif-plugged", "status": "completed", "tag": "2cb6fa8f-49a1-4c53-909c-8ac838368973"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:23:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-659975cd-9259-4f96-b73c-ab36e3687681 req-6c5d534d-9d82-48da-9972-0baef93e33bd service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-659975cd-9259-4f96-b73c-ab36e3687681 req-6c5d534d-9d82-48da-9972-0baef93e33bd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:48 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-659975cd-9259-4f96-b73c-ab36e3687681 req-6c5d534d-9d82-48da-9972-0baef93e33bd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:48 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-659975cd-9259-4f96-b73c-ab36e3687681 req-6c5d534d-9d82-48da-9972-0baef93e33bd service nova] Creating event network-vif-plugged:2cb6fa8f-49a1-4c53-909c-8ac838368973 for instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f on user Nov 27 02:23:48 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-659975cd-9259-4f96-b73c-ab36e3687681 req-6c5d534d-9d82-48da-9972-0baef93e33bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038031 Nov 27 02:23:48 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 419/1236] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:23:50 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-7fabfa97-8f42-482c-8378-3d8f3afbf623 req-650c14bf-cb06-4e9c-9b07-37921a7ddd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2449f1-ce09-4518-9ed0-d91d34b0d92f", "name": "network-vif-plugged", "status": "completed", "tag": "2cb6fa8f-49a1-4c53-909c-8ac838368973"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:23:50 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:50 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=8 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:50 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:23:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7fabfa97-8f42-482c-8378-3d8f3afbf623 req-650c14bf-cb06-4e9c-9b07-37921a7ddd0f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:23:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7fabfa97-8f42-482c-8378-3d8f3afbf623 req-650c14bf-cb06-4e9c-9b07-37921a7ddd0f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:23:50 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-7fabfa97-8f42-482c-8378-3d8f3afbf623 req-650c14bf-cb06-4e9c-9b07-37921a7ddd0f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:23:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-7fabfa97-8f42-482c-8378-3d8f3afbf623 req-650c14bf-cb06-4e9c-9b07-37921a7ddd0f service nova] Creating event network-vif-plugged:2cb6fa8f-49a1-4c53-909c-8ac838368973 for instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f on user Nov 27 02:23:50 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-7fabfa97-8f42-482c-8378-3d8f3afbf623 req-650c14bf-cb06-4e9c-9b07-37921a7ddd0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049914 Nov 27 02:23:50 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 409/1237] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:23:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:24:23 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:24:23 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-24aab7db-f78a-487f-872e-e17a466230c0 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f" status: 200 len: 1597 microversion: 2.1 time: 0.390933 Nov 27 02:24:23 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 410/1238] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:24:23 2023] GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f => generated 1597 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:23 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:23 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-97ff3436-4635-4958-a32d-e607b53e0faa tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.313452 Nov 27 02:25:23 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 420/1239] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:25:23 2023] GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f/os-interface => generated 283 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:25:24 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:25:24 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:25:24 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-b579a2b2-9824-4729-bc89-9a1ba4ef3f48 req-6c3c0413-d360-4ccb-85c9-9235d6a4d190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb2449f1-ce09-4518-9ed0-d91d34b0d92f", "tag": "2cb6fa8f-49a1-4c53-909c-8ac838368973"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:25:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b579a2b2-9824-4729-bc89-9a1ba4ef3f48 req-6c3c0413-d360-4ccb-85c9-9235d6a4d190 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b579a2b2-9824-4729-bc89-9a1ba4ef3f48 req-6c3c0413-d360-4ccb-85c9-9235d6a4d190 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:24 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b579a2b2-9824-4729-bc89-9a1ba4ef3f48 req-6c3c0413-d360-4ccb-85c9-9235d6a4d190 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b579a2b2-9824-4729-bc89-9a1ba4ef3f48 req-6c3c0413-d360-4ccb-85c9-9235d6a4d190 service nova] Creating event network-changed:2cb6fa8f-49a1-4c53-909c-8ac838368973 for instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f on user Nov 27 02:25:24 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-b579a2b2-9824-4729-bc89-9a1ba4ef3f48 req-6c3c0413-d360-4ccb-85c9-9235d6a4d190 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045707 Nov 27 02:25:24 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 410/1240] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:25:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:24 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:25 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:25:25 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-fcf825fc-1ad3-4ffc-9da5-bed19389acd5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f" status: 200 len: 1597 microversion: 2.1 time: 0.243008 Nov 27 02:25:25 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 411/1241] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:25:24 2023] GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f => generated 1597 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:25 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:25:25 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-d4e0da4a-d023-4b94-821e-2cada1afa672 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f" status: 204 len: 0 microversion: 2.1 time: 0.118552 Nov 27 02:25:25 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 421/1242] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:25:25 2023] DELETE /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:25 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:25:25 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0e8209d7-377f-4609-90d2-39b2026238f5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f" status: 200 len: 1722 microversion: 2.1 time: 0.262058 Nov 27 02:25:25 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 411/1243] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:25:25 2023] GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:25:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-4e0a31bd-d268-4871-bb1a-27f925ae9d83 req-3787f2e7-f7dc-44bf-90cc-5fe1f3dcc08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2449f1-ce09-4518-9ed0-d91d34b0d92f", "name": "network-vif-unplugged", "status": "completed", "tag": "2cb6fa8f-49a1-4c53-909c-8ac838368973"}, {"server_uuid": "bb2449f1-ce09-4518-9ed0-d91d34b0d92f", "name": "network-vif-plugged", "status": "completed", "tag": "2cb6fa8f-49a1-4c53-909c-8ac838368973"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:25:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e0a31bd-d268-4871-bb1a-27f925ae9d83 req-3787f2e7-f7dc-44bf-90cc-5fe1f3dcc08f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e0a31bd-d268-4871-bb1a-27f925ae9d83 req-3787f2e7-f7dc-44bf-90cc-5fe1f3dcc08f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-4e0a31bd-d268-4871-bb1a-27f925ae9d83 req-3787f2e7-f7dc-44bf-90cc-5fe1f3dcc08f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4e0a31bd-d268-4871-bb1a-27f925ae9d83 req-3787f2e7-f7dc-44bf-90cc-5fe1f3dcc08f service nova] Creating event network-vif-unplugged:2cb6fa8f-49a1-4c53-909c-8ac838368973 for instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f on user Nov 27 02:25:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-4e0a31bd-d268-4871-bb1a-27f925ae9d83 req-3787f2e7-f7dc-44bf-90cc-5fe1f3dcc08f service nova] Creating event network-vif-plugged:2cb6fa8f-49a1-4c53-909c-8ac838368973 for instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f on user Nov 27 02:25:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-4e0a31bd-d268-4871-bb1a-27f925ae9d83 req-3787f2e7-f7dc-44bf-90cc-5fe1f3dcc08f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029639 Nov 27 02:25:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 412/1244] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:25:26 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:25:28 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c173aece-6920-49d5-9697-bdb778c80448 req-21b2d5f6-0d05-492c-9f50-fb28473e1cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2449f1-ce09-4518-9ed0-d91d34b0d92f", "name": "network-vif-deleted", "tag": "2cb6fa8f-49a1-4c53-909c-8ac838368973"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:25:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c173aece-6920-49d5-9697-bdb778c80448 req-21b2d5f6-0d05-492c-9f50-fb28473e1cb4 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:25:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c173aece-6920-49d5-9697-bdb778c80448 req-21b2d5f6-0d05-492c-9f50-fb28473e1cb4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:25:28 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c173aece-6920-49d5-9697-bdb778c80448 req-21b2d5f6-0d05-492c-9f50-fb28473e1cb4 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:25:28 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-c173aece-6920-49d5-9697-bdb778c80448 req-21b2d5f6-0d05-492c-9f50-fb28473e1cb4 service nova] Creating event network-vif-deleted:2cb6fa8f-49a1-4c53-909c-8ac838368973 for instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f on user Nov 27 02:25:28 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c173aece-6920-49d5-9697-bdb778c80448 req-21b2d5f6-0d05-492c-9f50-fb28473e1cb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033172 Nov 27 02:25:28 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 422/1245] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:26:15 user devstack@n-api.service[65193]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=8 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:26:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f could not be found. Nov 27 02:26:15 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:26:15 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-547226b2-7940-4dba-86f5-645807c101af tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f" status: 404 len: 111 microversion: 2.1 time: 0.042111 Nov 27 02:26:15 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 412/1246] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:26:15 2023] GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:26:18 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:26:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-0c26011a-dc10-4ca1-b271-1446cc825807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce" status: 204 len: 0 microversion: 2.1 time: 0.112873 Nov 27 02:26:18 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 413/1247] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:26:18 2023] DELETE /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 02:26:18 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:26:18 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:26:18 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:26:18 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:26:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:26:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:26:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:26:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:26:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:26:19 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:26:19 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-93a86298-7c3a-40ee-a3a1-abc25a22f15e req-1958c6d8-d0b6-496e-ba34-e863cd07da8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3cdd24-fb6c-4e14-b310-4149812d1fce", "name": "network-vif-unplugged", "status": "completed", "tag": "574f4dee-3e45-4319-8a47-3443eb7da829"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:26:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-93a86298-7c3a-40ee-a3a1-abc25a22f15e req-1958c6d8-d0b6-496e-ba34-e863cd07da8f service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:26:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-93a86298-7c3a-40ee-a3a1-abc25a22f15e req-1958c6d8-d0b6-496e-ba34-e863cd07da8f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:26:19 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-93a86298-7c3a-40ee-a3a1-abc25a22f15e req-1958c6d8-d0b6-496e-ba34-e863cd07da8f service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:26:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-93a86298-7c3a-40ee-a3a1-abc25a22f15e req-1958c6d8-d0b6-496e-ba34-e863cd07da8f service nova] Creating event network-vif-unplugged:574f4dee-3e45-4319-8a47-3443eb7da829 for instance ca3cdd24-fb6c-4e14-b310-4149812d1fce on user Nov 27 02:26:19 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:26:19 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-93a86298-7c3a-40ee-a3a1-abc25a22f15e req-1958c6d8-d0b6-496e-ba34-e863cd07da8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033904 Nov 27 02:26:19 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 413/1248] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:26:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:26:19 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4cb63ab9-90a9-4003-9239-ba0b31f382e6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce" status: 200 len: 1563 microversion: 2.1 time: 0.246664 Nov 27 02:26:19 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 423/1249] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:26:18 2023] GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:26:21 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-e94565af-25b0-4313-9df3-e316c644cf78 req-cfb04b7a-4211-46f9-bb7d-17b8f95a4ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3cdd24-fb6c-4e14-b310-4149812d1fce", "name": "network-vif-plugged", "status": "completed", "tag": "574f4dee-3e45-4319-8a47-3443eb7da829"}, {"server_uuid": "ca3cdd24-fb6c-4e14-b310-4149812d1fce", "name": "network-vif-deleted", "tag": "574f4dee-3e45-4319-8a47-3443eb7da829"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:26:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e94565af-25b0-4313-9df3-e316c644cf78 req-cfb04b7a-4211-46f9-bb7d-17b8f95a4ba6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:26:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e94565af-25b0-4313-9df3-e316c644cf78 req-cfb04b7a-4211-46f9-bb7d-17b8f95a4ba6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:26:21 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e94565af-25b0-4313-9df3-e316c644cf78 req-cfb04b7a-4211-46f9-bb7d-17b8f95a4ba6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:26:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-e94565af-25b0-4313-9df3-e316c644cf78 req-cfb04b7a-4211-46f9-bb7d-17b8f95a4ba6 service nova] Creating event network-vif-plugged:574f4dee-3e45-4319-8a47-3443eb7da829 for instance ca3cdd24-fb6c-4e14-b310-4149812d1fce on user Nov 27 02:26:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-e94565af-25b0-4313-9df3-e316c644cf78 req-cfb04b7a-4211-46f9-bb7d-17b8f95a4ba6 service nova] Creating event network-vif-deleted:574f4dee-3e45-4319-8a47-3443eb7da829 for instance ca3cdd24-fb6c-4e14-b310-4149812d1fce on user Nov 27 02:26:21 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-e94565af-25b0-4313-9df3-e316c644cf78 req-cfb04b7a-4211-46f9-bb7d-17b8f95a4ba6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031434 Nov 27 02:26:21 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 414/1250] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:26:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:09 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51610. Nov 27 02:27:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance ca3cdd24-fb6c-4e14-b310-4149812d1fce could not be found. Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance ca3cdd24-fb6c-4e14-b310-4149812d1fce could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:27:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-1dbe294c-c031-4c7f-8e5e-ae01a5fc8403 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce" status: 404 len: 111 microversion: 2.1 time: 0.037415 Nov 27 02:27:09 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 414/1251] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:27:09 2023] GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f could not be found. Nov 27 02:27:09 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:27:09 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-43c27b28-556b-4cb9-9af1-bba35f458376 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f" status: 404 len: 111 microversion: 2.1 time: 0.033675 Nov 27 02:27:09 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 424/1252] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:27:09 2023] DELETE /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: bb2449f1-ce09-4518-9ed0-d91d34b0d92f] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f could not be found. Nov 27 02:27:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance bb2449f1-ce09-4518-9ed0-d91d34b0d92f could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:27:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-f3c8b63f-85f0-40a8-92fd-0fcab5a604c7 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f" status: 404 len: 111 microversion: 2.1 time: 0.037895 Nov 27 02:27:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 415/1253] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:27:09 2023] GET /compute/v2.1/servers/bb2449f1-ce09-4518-9ed0-d91d34b0d92f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:27:09 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-cd33a000-cf72-44db-9450-0be3a1b89948 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '.version_select at 0x7f364b02b760>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:27:09 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-cd33a000-cf72-44db-9450-0be3a1b89948 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-490804150" status: 202 len: 0 microversion: 2.1 time: 0.037731 Nov 27 02:27:09 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 415/1254] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 02:27:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-490804150 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance ca3cdd24-fb6c-4e14-b310-4149812d1fce could not be found. Nov 27 02:27:10 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance ca3cdd24-fb6c-4e14-b310-4149812d1fce could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:27:10 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-7ad62d69-d6dd-48af-9e14-b393c1733219 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce" status: 404 len: 111 microversion: 2.1 time: 0.027191 Nov 27 02:27:10 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 425/1255] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:27:10 2023] DELETE /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: ca3cdd24-fb6c-4e14-b310-4149812d1fce] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:10 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance ca3cdd24-fb6c-4e14-b310-4149812d1fce could not be found. Nov 27 02:27:10 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance ca3cdd24-fb6c-4e14-b310-4149812d1fce could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:27:10 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-8fba2618-180e-428f-81ac-526749871807 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce" status: 404 len: 111 microversion: 2.1 time: 0.029375 Nov 27 02:27:10 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 416/1256] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:27:10 2023] GET /compute/v2.1/servers/ca3cdd24-fb6c-4e14-b310-4149812d1fce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:27:10 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-581b0ef3-5104-4e04-ae99-fddf6f063f26 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '.version_select at 0x7f364b028310>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:27:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-581b0ef3-5104-4e04-ae99-fddf6f063f26 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-250614271" status: 202 len: 0 microversion: 2.1 time: 0.024470 Nov 27 02:27:10 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 416/1257] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 02:27:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-250614271 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:27:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-66edb74f-680f-4933-975d-6aa1bbd23d8b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: .version_select at 0x7f364afb3e20>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1203669430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBpL5D/Uq4M0l6QZDwWpZDMkJH7FXxmNfAWquTrzEJ1RDtO7o4zXNhuE8SXi0McU2aj2afGkmUainnp/fNI9+PIm15BM13niXMaZlO+P2H6ucx9ydjEPX1HNj/2SIrdnw=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:27:11 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-66edb74f-680f-4933-975d-6aa1bbd23d8b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:27:11 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-66edb74f-680f-4933-975d-6aa1bbd23d8b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:27:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-66edb74f-680f-4933-975d-6aa1bbd23d8b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.045270 Nov 27 02:27:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 426/1258] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:27:11 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:27:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1057759231", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-56499372"}], "block_device_mapping_v2": [{"uuid": "a1a7c240-3585-46bf-a3fb-15e9e47bc383", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1203669430", "networks": [{"uuid": "675bf9c2-df4c-4902-aca4-7b7df68322da"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:27:17 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] validate_networks() for [('675bf9c2-df4c-4902-aca4-7b7df68322da', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:27:18 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1a7c240-3585-46bf-a3fb-15e9e47bc383',volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:27:18 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-759db763-7c21-4889-9ddc-0e72c3a863d9 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.772296 Nov 27 02:27:18 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 417/1259] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:27:17 2023] POST /compute/v2.1/servers => generated 402 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:27:18 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-6388e002-43fa-42a2-b13d-6ab3dd2722f1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:27:18 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-6388e002-43fa-42a2-b13d-6ab3dd2722f1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:27:18 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-6388e002-43fa-42a2-b13d-6ab3dd2722f1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:27:18 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-6388e002-43fa-42a2-b13d-6ab3dd2722f1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147" status: 200 len: 1088 microversion: 2.1 time: 0.141015 Nov 27 02:27:18 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 417/1260] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:27:18 2023] GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 => generated 1088 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:27:20 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:20 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-b2032175-f72b-4f44-906b-f235134e0cfe req-76927d78-8b18-4fb7-bebe-0fe745b575bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e520ec4-aa92-42ca-9ec7-ada6805ca147", "tag": "542a562c-86f2-4d35-88c6-e16db8a48010"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:27:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b2032175-f72b-4f44-906b-f235134e0cfe req-76927d78-8b18-4fb7-bebe-0fe745b575bd service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b2032175-f72b-4f44-906b-f235134e0cfe req-76927d78-8b18-4fb7-bebe-0fe745b575bd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:20 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-b2032175-f72b-4f44-906b-f235134e0cfe req-76927d78-8b18-4fb7-bebe-0fe745b575bd service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-b2032175-f72b-4f44-906b-f235134e0cfe req-76927d78-8b18-4fb7-bebe-0fe745b575bd service nova] Creating event network-changed:542a562c-86f2-4d35-88c6-e16db8a48010 for instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 on user Nov 27 02:27:20 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-b2032175-f72b-4f44-906b-f235134e0cfe req-76927d78-8b18-4fb7-bebe-0fe745b575bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036705 Nov 27 02:27:20 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 427/1261] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:27:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:27:28 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-e681f33f-2ab8-420e-9942-48787072f707 req-66bd0033-26e0-44cb-bb73-751c633c6427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e520ec4-aa92-42ca-9ec7-ada6805ca147", "name": "network-vif-plugged", "status": "completed", "tag": "542a562c-86f2-4d35-88c6-e16db8a48010"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:27:28 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:28 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:28 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:28 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e681f33f-2ab8-420e-9942-48787072f707 req-66bd0033-26e0-44cb-bb73-751c633c6427 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e681f33f-2ab8-420e-9942-48787072f707 req-66bd0033-26e0-44cb-bb73-751c633c6427 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:28 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e681f33f-2ab8-420e-9942-48787072f707 req-66bd0033-26e0-44cb-bb73-751c633c6427 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-e681f33f-2ab8-420e-9942-48787072f707 req-66bd0033-26e0-44cb-bb73-751c633c6427 service nova] Creating event network-vif-plugged:542a562c-86f2-4d35-88c6-e16db8a48010 for instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 on user Nov 27 02:27:28 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-e681f33f-2ab8-420e-9942-48787072f707 req-66bd0033-26e0-44cb-bb73-751c633c6427 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054539 Nov 27 02:27:28 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 418/1262] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:27:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:27:30 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-ec8e48d2-cac3-4a93-84e9-31dfb4d99c5c req-c464fa2c-b978-4508-9a04-9f481250dd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e520ec4-aa92-42ca-9ec7-ada6805ca147", "name": "network-vif-plugged", "status": "completed", "tag": "542a562c-86f2-4d35-88c6-e16db8a48010"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:27:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:30 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:27:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ec8e48d2-cac3-4a93-84e9-31dfb4d99c5c req-c464fa2c-b978-4508-9a04-9f481250dd39 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:27:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ec8e48d2-cac3-4a93-84e9-31dfb4d99c5c req-c464fa2c-b978-4508-9a04-9f481250dd39 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:27:30 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-ec8e48d2-cac3-4a93-84e9-31dfb4d99c5c req-c464fa2c-b978-4508-9a04-9f481250dd39 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:27:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-ec8e48d2-cac3-4a93-84e9-31dfb4d99c5c req-c464fa2c-b978-4508-9a04-9f481250dd39 service nova] Creating event network-vif-plugged:542a562c-86f2-4d35-88c6-e16db8a48010 for instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 on user Nov 27 02:27:30 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-ec8e48d2-cac3-4a93-84e9-31dfb4d99c5c req-c464fa2c-b978-4508-9a04-9f481250dd39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040447 Nov 27 02:27:30 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 418/1263] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:27:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:28:08 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:28:08 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4f7d760b-753e-4275-8361-706b92d21ce3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147" status: 200 len: 1439 microversion: 2.1 time: 0.229438 Nov 27 02:28:08 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 428/1264] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:28:08 2023] GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 => generated 1439 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:29:08 user devstack@n-api.service[65192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 27 02:29:08 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:29:08 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:09 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:29:09 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e468a57f-3492-4692-bea4-f9e932f8a911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147" status: 200 len: 1439 microversion: 2.1 time: 0.436476 Nov 27 02:29:09 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 419/1265] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:29:08 2023] GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 => generated 1439 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:29:10 user devstack@n-api.service[65193]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 27 02:29:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:29:10 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:29:10 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-b110d555-2031-4cb1-a8ec-5629a1ceecd2 req-496117f9-f744-4637-839e-d3e09a7704a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e520ec4-aa92-42ca-9ec7-ada6805ca147", "tag": "542a562c-86f2-4d35-88c6-e16db8a48010"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:29:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b110d555-2031-4cb1-a8ec-5629a1ceecd2 req-496117f9-f744-4637-839e-d3e09a7704a5 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b110d555-2031-4cb1-a8ec-5629a1ceecd2 req-496117f9-f744-4637-839e-d3e09a7704a5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:10 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-b110d555-2031-4cb1-a8ec-5629a1ceecd2 req-496117f9-f744-4637-839e-d3e09a7704a5 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-b110d555-2031-4cb1-a8ec-5629a1ceecd2 req-496117f9-f744-4637-839e-d3e09a7704a5 service nova] Creating event network-changed:542a562c-86f2-4d35-88c6-e16db8a48010 for instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 on user Nov 27 02:29:10 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-b110d555-2031-4cb1-a8ec-5629a1ceecd2 req-496117f9-f744-4637-839e-d3e09a7704a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192183 Nov 27 02:29:10 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 419/1266] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:29:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:11 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:29:11 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4d249fe7-9d31-4f6d-81fc-e301f0761b42 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147" status: 204 len: 0 microversion: 2.1 time: 0.122167 Nov 27 02:29:11 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 429/1267] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:29:11 2023] DELETE /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:11 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 59994. Nov 27 02:29:11 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:29:11 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-ab0a032c-1a60-4820-8d06-154f2a7061b2 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147" status: 200 len: 1564 microversion: 2.1 time: 0.227727 Nov 27 02:29:11 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 420/1268] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:29:11 2023] GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 => generated 1564 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:29:11 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-38739db7-8942-4311-b67e-8bd261264081 req-a1692c6d-ede5-4df0-96b2-d112b2a57545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e520ec4-aa92-42ca-9ec7-ada6805ca147", "name": "network-vif-unplugged", "status": "completed", "tag": "542a562c-86f2-4d35-88c6-e16db8a48010"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:29:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-38739db7-8942-4311-b67e-8bd261264081 req-a1692c6d-ede5-4df0-96b2-d112b2a57545 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-38739db7-8942-4311-b67e-8bd261264081 req-a1692c6d-ede5-4df0-96b2-d112b2a57545 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:11 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-38739db7-8942-4311-b67e-8bd261264081 req-a1692c6d-ede5-4df0-96b2-d112b2a57545 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-38739db7-8942-4311-b67e-8bd261264081 req-a1692c6d-ede5-4df0-96b2-d112b2a57545 service nova] Creating event network-vif-unplugged:542a562c-86f2-4d35-88c6-e16db8a48010 for instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 on user Nov 27 02:29:11 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-38739db7-8942-4311-b67e-8bd261264081 req-a1692c6d-ede5-4df0-96b2-d112b2a57545 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091282 Nov 27 02:29:11 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 420/1269] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:29:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:29:13 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-96e79d25-dfca-4183-8db4-42dfdff40f09 req-ef130ee5-59a2-400a-8970-94fda69ccfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e520ec4-aa92-42ca-9ec7-ada6805ca147", "name": "network-vif-plugged", "status": "completed", "tag": "542a562c-86f2-4d35-88c6-e16db8a48010"}, {"server_uuid": "9e520ec4-aa92-42ca-9ec7-ada6805ca147", "name": "network-vif-deleted", "tag": "542a562c-86f2-4d35-88c6-e16db8a48010"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:29:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-96e79d25-dfca-4183-8db4-42dfdff40f09 req-ef130ee5-59a2-400a-8970-94fda69ccfb3 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:29:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-96e79d25-dfca-4183-8db4-42dfdff40f09 req-ef130ee5-59a2-400a-8970-94fda69ccfb3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:29:13 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-96e79d25-dfca-4183-8db4-42dfdff40f09 req-ef130ee5-59a2-400a-8970-94fda69ccfb3 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:29:13 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-96e79d25-dfca-4183-8db4-42dfdff40f09 req-ef130ee5-59a2-400a-8970-94fda69ccfb3 service nova] Creating event network-vif-plugged:542a562c-86f2-4d35-88c6-e16db8a48010 for instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 on user Nov 27 02:29:13 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-96e79d25-dfca-4183-8db4-42dfdff40f09 req-ef130ee5-59a2-400a-8970-94fda69ccfb3 service nova] Creating event network-vif-deleted:542a562c-86f2-4d35-88c6-e16db8a48010 for instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 on user Nov 27 02:29:13 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-96e79d25-dfca-4183-8db4-42dfdff40f09 req-ef130ee5-59a2-400a-8970-94fda69ccfb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030948 Nov 27 02:29:13 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 430/1270] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:29:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:30:01 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 27 02:30:01 user devstack@n-api.service[65192]: Mon Nov 27 02:30:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 (ip 10.0.0.210) !!! Nov 27 02:30:01 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 27 02:30:01 user devstack@n-api.service[65192]: Mon Nov 27 02:30:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 (ip 10.0.0.210) !!! Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=12 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 could not be found. Nov 27 02:30:01 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:30:01 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-3978ec87-f0a2-4910-a321-c6f6de593df3 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147" status: 404 len: 111 microversion: 2.1 time: 0.040739 Nov 27 02:30:01 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 421/1271] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:30:01 2023] GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:30:02 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 27 02:30:02 user devstack@n-api.service[65193]: Mon Nov 27 02:30:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-615740059", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-56499372"}], "block_device_mapping_v2": [{"uuid": "a1a7c240-3585-46bf-a3fb-15e9e47bc383", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1203669430", "networks": [{"uuid": "675bf9c2-df4c-4902-aca4-7b7df68322da"}]}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:30:02 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 53470. Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.network.neutron [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] validate_networks() for [('675bf9c2-df4c-4902-aca4-7b7df68322da', None, None, None, None, None)] {{(pid=65193) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image limits 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image pref 0:0:0 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.virt.hardware [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.quota [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Going to run 1 instances... {{(pid=65193) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:30:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 7b7bf45f-26da-4ef8-a83e-50807aad4384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1a7c240-3585-46bf-a3fb-15e9e47bc383',volume_size=None,volume_type=None)] {{(pid=65193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:30:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-29dac353-f3c9-45de-b9c6-dac570dc4d90 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.826634 Nov 27 02:30:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 421/1272] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:30:02 2023] POST /compute/v2.1/servers => generated 402 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:30:02 user devstack@n-api.service[65194]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d93a33c4-2c4a-4e51-984a-1d3906e48e4f] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:30:02 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:02 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:02 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-e6675826-cc7a-4f84-a4b1-a14d8f8782a5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:30:02 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-e6675826-cc7a-4f84-a4b1-a14d8f8782a5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 7b7bf45f-26da-4ef8-a83e-50807aad4384] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:30:02 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-e6675826-cc7a-4f84-a4b1-a14d8f8782a5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:30:02 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-e6675826-cc7a-4f84-a4b1-a14d8f8782a5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384" status: 200 len: 1087 microversion: 2.1 time: 0.072345 Nov 27 02:30:02 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 431/1273] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:30:02 2023] GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384 => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 27 02:30:05 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-24f17bf9-cf12-4b85-aaa8-87d02c9a1f13 req-8dcf3d23-a0a6-43dd-9b03-e76cbf451c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7bf45f-26da-4ef8-a83e-50807aad4384", "tag": "e74a11b2-3b88-4b9e-bef5-5c0a97c7602a"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:30:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-24f17bf9-cf12-4b85-aaa8-87d02c9a1f13 req-8dcf3d23-a0a6-43dd-9b03-e76cbf451c6a service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-24f17bf9-cf12-4b85-aaa8-87d02c9a1f13 req-8dcf3d23-a0a6-43dd-9b03-e76cbf451c6a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:05 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-24f17bf9-cf12-4b85-aaa8-87d02c9a1f13 req-8dcf3d23-a0a6-43dd-9b03-e76cbf451c6a service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:05 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-24f17bf9-cf12-4b85-aaa8-87d02c9a1f13 req-8dcf3d23-a0a6-43dd-9b03-e76cbf451c6a service nova] Creating event network-changed:e74a11b2-3b88-4b9e-bef5-5c0a97c7602a for instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 on user Nov 27 02:30:05 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-24f17bf9-cf12-4b85-aaa8-87d02c9a1f13 req-8dcf3d23-a0a6-43dd-9b03-e76cbf451c6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030282 Nov 27 02:30:05 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 422/1274] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:30:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:30:12 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:12 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:12 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:12 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-4226d1aa-2982-4d24-a274-413a9b645313 req-c5564dc7-4c66-4803-bea8-2a777f47c201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7bf45f-26da-4ef8-a83e-50807aad4384", "name": "network-vif-plugged", "status": "completed", "tag": "e74a11b2-3b88-4b9e-bef5-5c0a97c7602a"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:30:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-4226d1aa-2982-4d24-a274-413a9b645313 req-c5564dc7-4c66-4803-bea8-2a777f47c201 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-4226d1aa-2982-4d24-a274-413a9b645313 req-c5564dc7-4c66-4803-bea8-2a777f47c201 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:12 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-4226d1aa-2982-4d24-a274-413a9b645313 req-c5564dc7-4c66-4803-bea8-2a777f47c201 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-4226d1aa-2982-4d24-a274-413a9b645313 req-c5564dc7-4c66-4803-bea8-2a777f47c201 service nova] Creating event network-vif-plugged:e74a11b2-3b88-4b9e-bef5-5c0a97c7602a for instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 on user Nov 27 02:30:12 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-4226d1aa-2982-4d24-a274-413a9b645313 req-c5564dc7-4c66-4803-bea8-2a777f47c201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060035 Nov 27 02:30:12 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 422/1275] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:30:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:30:14 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-4dba1bf0-db9e-4559-a329-ddc03284c54b req-b7656a6c-43e7-4fab-ad6d-a580aff8bb48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7bf45f-26da-4ef8-a83e-50807aad4384", "name": "network-vif-plugged", "status": "completed", "tag": "e74a11b2-3b88-4b9e-bef5-5c0a97c7602a"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:30:14 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:14 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4dba1bf0-db9e-4559-a329-ddc03284c54b req-b7656a6c-43e7-4fab-ad6d-a580aff8bb48 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4dba1bf0-db9e-4559-a329-ddc03284c54b req-b7656a6c-43e7-4fab-ad6d-a580aff8bb48 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:14 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-4dba1bf0-db9e-4559-a329-ddc03284c54b req-b7656a6c-43e7-4fab-ad6d-a580aff8bb48 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:14 user devstack@n-api.service[65194]: INFO oslo.messaging._drivers.impl_rabbit [-] [d93a33c4-2c4a-4e51-984a-1d3906e48e4f] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 35434. Nov 27 02:30:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-4dba1bf0-db9e-4559-a329-ddc03284c54b req-b7656a6c-43e7-4fab-ad6d-a580aff8bb48 service nova] Creating event network-vif-plugged:e74a11b2-3b88-4b9e-bef5-5c0a97c7602a for instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 on user Nov 27 02:30:14 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-4dba1bf0-db9e-4559-a329-ddc03284c54b req-b7656a6c-43e7-4fab-ad6d-a580aff8bb48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037222 Nov 27 02:30:14 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 432/1276] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 7b7bf45f-26da-4ef8-a83e-50807aad4384] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:30:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:30:53 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:30:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-b457cd0e-e0c1-4c50-ab0b-6d8e8b4e4acf tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384" status: 200 len: 1438 microversion: 2.1 time: 0.362432 Nov 27 02:30:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 423/1277] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:30:52 2023] GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384 => generated 1438 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:31:53 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:31:53 user devstack@n-api.service[65193]: Mon Nov 27 02:31:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384 (ip 10.0.0.210) !!! Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 7b7bf45f-26da-4ef8-a83e-50807aad4384] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:31:53 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:31:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0050a89e-7279-4486-99e4-7259f832cce6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384" status: 200 len: 1438 microversion: 2.1 time: 0.235026 Nov 27 02:31:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 423/1278] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:31:53 2023] GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384 => generated 1438 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:31:55 user devstack@n-api.service[65194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:31:55 user devstack@n-api.service[65194]: Mon Nov 27 02:31:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 27 02:31:55 user devstack@n-api.service[65194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:31:55 user devstack@n-api.service[65194]: Mon Nov 27 02:31:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 27 02:31:55 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:31:55 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:31:55 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-cf896def-7b93-48b8-bebf-667734ad00ab req-3c4d2881-50b4-46af-9a7b-7e1e629408e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7bf45f-26da-4ef8-a83e-50807aad4384", "tag": "e74a11b2-3b88-4b9e-bef5-5c0a97c7602a"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:31:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-cf896def-7b93-48b8-bebf-667734ad00ab req-3c4d2881-50b4-46af-9a7b-7e1e629408e0 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:31:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-cf896def-7b93-48b8-bebf-667734ad00ab req-3c4d2881-50b4-46af-9a7b-7e1e629408e0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:31:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-cf896def-7b93-48b8-bebf-667734ad00ab req-3c4d2881-50b4-46af-9a7b-7e1e629408e0 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:31:55 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-cf896def-7b93-48b8-bebf-667734ad00ab req-3c4d2881-50b4-46af-9a7b-7e1e629408e0 service nova] Creating event network-changed:e74a11b2-3b88-4b9e-bef5-5c0a97c7602a for instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 on user Nov 27 02:31:55 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-cf896def-7b93-48b8-bebf-667734ad00ab req-3c4d2881-50b4-46af-9a7b-7e1e629408e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053035 Nov 27 02:31:55 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 433/1279] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:32:01 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:32:01 user devstack@n-api.service[65192]: Mon Nov 27 02:32:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-515961206", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-56499372"}], "block_device_mapping_v2": [{"uuid": "ab38e3b1-3f96-4965-aef3-f8fb939026bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-1203669430", "networks": [{"uuid": "675bf9c2-df4c-4902-aca4-7b7df68322da"}]}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] validate_networks() for [('675bf9c2-df4c-4902-aca4-7b7df68322da', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:32:01 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Getting quotas for user 88ce28ae5d00425aa86e27f13d7c07d9 and project f6227f7dcddc4c23ad0814748fe07197. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:32:02 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:32:02 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab38e3b1-3f96-4965-aef3-f8fb939026bb',volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:32:02 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-c47ed4a7-d5df-492a-ac4c-628ff331c7dd tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.893703 Nov 27 02:32:02 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 424/1280] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:32:01 2023] POST /compute/v2.1/servers => generated 402 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:32:02 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-0393a29e-ddf1-4a7f-a9f9-4f8e0051fc40 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:32:02 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-0393a29e-ddf1-4a7f-a9f9-4f8e0051fc40 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:32:02 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-0393a29e-ddf1-4a7f-a9f9-4f8e0051fc40 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:32:02 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-0393a29e-ddf1-4a7f-a9f9-4f8e0051fc40 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4" status: 200 len: 1087 microversion: 2.1 time: 0.076360 Nov 27 02:32:02 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 424/1281] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:32:02 2023] GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:32:04 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-c86aa16e-1a69-4cce-ac6f-a0b5abc9d81d req-74a98b8f-3d0d-46e3-9f24-2412d6c3aeeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4", "tag": "305c7325-3cc9-4220-b559-95f3dc9b6828"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:32:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c86aa16e-1a69-4cce-ac6f-a0b5abc9d81d req-74a98b8f-3d0d-46e3-9f24-2412d6c3aeeb service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:32:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c86aa16e-1a69-4cce-ac6f-a0b5abc9d81d req-74a98b8f-3d0d-46e3-9f24-2412d6c3aeeb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:32:04 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-c86aa16e-1a69-4cce-ac6f-a0b5abc9d81d req-74a98b8f-3d0d-46e3-9f24-2412d6c3aeeb service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:32:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-c86aa16e-1a69-4cce-ac6f-a0b5abc9d81d req-74a98b8f-3d0d-46e3-9f24-2412d6c3aeeb service nova] Creating event network-changed:305c7325-3cc9-4220-b559-95f3dc9b6828 for instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 on user Nov 27 02:32:04 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-c86aa16e-1a69-4cce-ac6f-a0b5abc9d81d req-74a98b8f-3d0d-46e3-9f24-2412d6c3aeeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043402 Nov 27 02:32:04 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 434/1282] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:32:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:32:14 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:14 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:14 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:14 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:14 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-ffc50971-437e-4971-ba44-57702ba6eaa8 req-4f1a0f92-ff8b-4b1b-b4d7-38be14cfe1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4", "name": "network-vif-plugged", "status": "completed", "tag": "305c7325-3cc9-4220-b559-95f3dc9b6828"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:32:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ffc50971-437e-4971-ba44-57702ba6eaa8 req-4f1a0f92-ff8b-4b1b-b4d7-38be14cfe1fe service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:32:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ffc50971-437e-4971-ba44-57702ba6eaa8 req-4f1a0f92-ff8b-4b1b-b4d7-38be14cfe1fe service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:32:14 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-ffc50971-437e-4971-ba44-57702ba6eaa8 req-4f1a0f92-ff8b-4b1b-b4d7-38be14cfe1fe service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:32:14 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-ffc50971-437e-4971-ba44-57702ba6eaa8 req-4f1a0f92-ff8b-4b1b-b4d7-38be14cfe1fe service nova] Creating event network-vif-plugged:305c7325-3cc9-4220-b559-95f3dc9b6828 for instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 on user Nov 27 02:32:14 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-ffc50971-437e-4971-ba44-57702ba6eaa8 req-4f1a0f92-ff8b-4b1b-b4d7-38be14cfe1fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054988 Nov 27 02:32:14 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 425/1283] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:32:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:32:16 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-42aaaaa0-eb8c-444c-88c5-72819ab596b5 req-ebd5e4e1-a47b-42a1-a2aa-5893891a1c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4", "name": "network-vif-plugged", "status": "completed", "tag": "305c7325-3cc9-4220-b559-95f3dc9b6828"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:32:16 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:16 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:16 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-42aaaaa0-eb8c-444c-88c5-72819ab596b5 req-ebd5e4e1-a47b-42a1-a2aa-5893891a1c77 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:32:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-42aaaaa0-eb8c-444c-88c5-72819ab596b5 req-ebd5e4e1-a47b-42a1-a2aa-5893891a1c77 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:32:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-42aaaaa0-eb8c-444c-88c5-72819ab596b5 req-ebd5e4e1-a47b-42a1-a2aa-5893891a1c77 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:32:16 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-42aaaaa0-eb8c-444c-88c5-72819ab596b5 req-ebd5e4e1-a47b-42a1-a2aa-5893891a1c77 service nova] Creating event network-vif-plugged:305c7325-3cc9-4220-b559-95f3dc9b6828 for instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 on user Nov 27 02:32:16 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-42aaaaa0-eb8c-444c-88c5-72819ab596b5 req-ebd5e4e1-a47b-42a1-a2aa-5893891a1c77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041071 Nov 27 02:32:16 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 425/1284] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:32:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:32:52 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:32:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-638d2836-cd09-47b1-8ed3-3f42abd64aa5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4" status: 200 len: 1438 microversion: 2.1 time: 0.296997 Nov 27 02:32:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 435/1285] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:32:52 2023] GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 => generated 1438 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:33:52 user devstack@n-api.service[65192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:52 user devstack@n-api.service[65192]: DEBUG nova.policy [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65192) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:33:52 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-bbd47d4e-771b-44e5-af13-8ff6461c82ae tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4" status: 200 len: 1438 microversion: 2.1 time: 0.294826 Nov 27 02:33:52 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 426/1286] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:33:52 2023] GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 => generated 1438 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:33:54 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:33:54 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:33:54 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-9d739904-7446-4760-8321-5fffbba3ec35 req-88577ea4-bd0e-4770-a65d-6fd544bf43e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4", "tag": "305c7325-3cc9-4220-b559-95f3dc9b6828"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:33:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9d739904-7446-4760-8321-5fffbba3ec35 req-88577ea4-bd0e-4770-a65d-6fd544bf43e9 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9d739904-7446-4760-8321-5fffbba3ec35 req-88577ea4-bd0e-4770-a65d-6fd544bf43e9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:54 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-9d739904-7446-4760-8321-5fffbba3ec35 req-88577ea4-bd0e-4770-a65d-6fd544bf43e9 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-9d739904-7446-4760-8321-5fffbba3ec35 req-88577ea4-bd0e-4770-a65d-6fd544bf43e9 service nova] Creating event network-changed:305c7325-3cc9-4220-b559-95f3dc9b6828 for instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 on user Nov 27 02:33:54 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-9d739904-7446-4760-8321-5fffbba3ec35 req-88577ea4-bd0e-4770-a65d-6fd544bf43e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094781 Nov 27 02:33:54 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 426/1287] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:33:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:33:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-31f6540d-f8fd-4a76-bf38-0815f6e222d5 req-e5de8bf1-756f-47a8-a78f-c6c1c65530ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4", "tag": "305c7325-3cc9-4220-b559-95f3dc9b6828"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:33:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-31f6540d-f8fd-4a76-bf38-0815f6e222d5 req-e5de8bf1-756f-47a8-a78f-c6c1c65530ad service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-31f6540d-f8fd-4a76-bf38-0815f6e222d5 req-e5de8bf1-756f-47a8-a78f-c6c1c65530ad service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-31f6540d-f8fd-4a76-bf38-0815f6e222d5 req-e5de8bf1-756f-47a8-a78f-c6c1c65530ad service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:55 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 32792. Nov 27 02:33:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-31f6540d-f8fd-4a76-bf38-0815f6e222d5 req-e5de8bf1-756f-47a8-a78f-c6c1c65530ad service nova] Creating event network-changed:305c7325-3cc9-4220-b559-95f3dc9b6828 for instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 on user Nov 27 02:33:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-31f6540d-f8fd-4a76-bf38-0815f6e222d5 req-e5de8bf1-756f-47a8-a78f-c6c1c65530ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034066 Nov 27 02:33:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 427/1288] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:33:55 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4] Going to try to terminate instance {{(pid=65194) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:33:55 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-99c63dda-e6c0-4279-ba33-02c7eb89fdd1 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4" status: 204 len: 0 microversion: 2.1 time: 0.120432 Nov 27 02:33:55 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 436/1289] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:33:55 2023] DELETE /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:55 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:33:55 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-71ae3867-d59b-4603-803e-eaadf903a5c5 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4" status: 200 len: 1562 microversion: 2.1 time: 0.289644 Nov 27 02:33:55 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 427/1290] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:33:55 2023] GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 => generated 1562 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:33:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-a5df6167-9dfa-4292-835e-f6a7e818e89c req-0d33979f-ff4b-4ee6-a99d-4311be76e3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4", "name": "network-vif-unplugged", "status": "completed", "tag": "305c7325-3cc9-4220-b559-95f3dc9b6828"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:33:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a5df6167-9dfa-4292-835e-f6a7e818e89c req-0d33979f-ff4b-4ee6-a99d-4311be76e3e2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a5df6167-9dfa-4292-835e-f6a7e818e89c req-0d33979f-ff4b-4ee6-a99d-4311be76e3e2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:55 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-a5df6167-9dfa-4292-835e-f6a7e818e89c req-0d33979f-ff4b-4ee6-a99d-4311be76e3e2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-a5df6167-9dfa-4292-835e-f6a7e818e89c req-0d33979f-ff4b-4ee6-a99d-4311be76e3e2 service nova] Creating event network-vif-unplugged:305c7325-3cc9-4220-b559-95f3dc9b6828 for instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 on user Nov 27 02:33:55 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-a5df6167-9dfa-4292-835e-f6a7e818e89c req-0d33979f-ff4b-4ee6-a99d-4311be76e3e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028223 Nov 27 02:33:55 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 428/1291] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:33:57 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-d861e0d1-c45f-4122-962e-d5c11675ab83 req-c0b8f237-394c-46d7-b150-1c60c86213df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4", "name": "network-vif-plugged", "status": "completed", "tag": "305c7325-3cc9-4220-b559-95f3dc9b6828"}, {"server_uuid": "4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4", "name": "network-vif-deleted", "tag": "305c7325-3cc9-4220-b559-95f3dc9b6828"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:33:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d861e0d1-c45f-4122-962e-d5c11675ab83 req-c0b8f237-394c-46d7-b150-1c60c86213df service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:33:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d861e0d1-c45f-4122-962e-d5c11675ab83 req-c0b8f237-394c-46d7-b150-1c60c86213df service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:33:57 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-d861e0d1-c45f-4122-962e-d5c11675ab83 req-c0b8f237-394c-46d7-b150-1c60c86213df service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:33:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d861e0d1-c45f-4122-962e-d5c11675ab83 req-c0b8f237-394c-46d7-b150-1c60c86213df service nova] Creating event network-vif-plugged:305c7325-3cc9-4220-b559-95f3dc9b6828 for instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 on user Nov 27 02:33:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-d861e0d1-c45f-4122-962e-d5c11675ab83 req-c0b8f237-394c-46d7-b150-1c60c86213df service nova] Creating event network-vif-deleted:305c7325-3cc9-4220-b559-95f3dc9b6828 for instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 on user Nov 27 02:33:57 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-d861e0d1-c45f-4122-962e-d5c11675ab83 req-c0b8f237-394c-46d7-b150-1c60c86213df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029338 Nov 27 02:33:57 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 437/1292] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:33:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=8 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 could not be found. Nov 27 02:34:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance 4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:34:45 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-78bf3e04-53ba-4db3-b1a5-44d5cd52227b tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4" status: 404 len: 111 microversion: 2.1 time: 0.106641 Nov 27 02:34:45 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 428/1293] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:34:45 2023] GET /compute/v2.1/servers/4e1f6b30-dbf9-45cd-aae4-33007eb1f6a4 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=8 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=10 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 7b7bf45f-26da-4ef8-a83e-50807aad4384] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:34:53 user devstack@n-api.service[65194]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d93a33c4-2c4a-4e51-984a-1d3906e48e4f] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:53 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 7b7bf45f-26da-4ef8-a83e-50807aad4384] Going to try to terminate instance {{(pid=65192) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-ed86987f-6cd0-4ffc-9609-14e613826bc4 req-06a46d2b-d2cc-4d64-a2b4-286bcd4fbb77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7bf45f-26da-4ef8-a83e-50807aad4384", "tag": "e74a11b2-3b88-4b9e-bef5-5c0a97c7602a"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ed86987f-6cd0-4ffc-9609-14e613826bc4 req-06a46d2b-d2cc-4d64-a2b4-286bcd4fbb77 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ed86987f-6cd0-4ffc-9609-14e613826bc4 req-06a46d2b-d2cc-4d64-a2b4-286bcd4fbb77 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-ed86987f-6cd0-4ffc-9609-14e613826bc4 req-06a46d2b-d2cc-4d64-a2b4-286bcd4fbb77 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-ed86987f-6cd0-4ffc-9609-14e613826bc4 req-06a46d2b-d2cc-4d64-a2b4-286bcd4fbb77 service nova] Creating event network-changed:e74a11b2-3b88-4b9e-bef5-5c0a97c7602a for instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 on user Nov 27 02:34:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-ed86987f-6cd0-4ffc-9609-14e613826bc4 req-06a46d2b-d2cc-4d64-a2b4-286bcd4fbb77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105056 Nov 27 02:34:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 438/1294] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:34:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e56e2f0c-c777-4295-bd87-06b83b112911 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384" status: 204 len: 0 microversion: 2.1 time: 0.137447 Nov 27 02:34:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 429/1295] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:34:53 2023] DELETE /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 7b7bf45f-26da-4ef8-a83e-50807aad4384] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:53 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ce28ae5d00425aa86e27f13d7c07d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6227f7dcddc4c23ad0814748fe07197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:34:53 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-06a0f81f-e934-462f-985c-b8da36435ffb tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384" status: 200 len: 1562 microversion: 2.1 time: 0.275910 Nov 27 02:34:53 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 429/1296] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:34:53 2023] GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384 => generated 1562 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-5c1e789b-9d3f-4fc0-b3aa-7182052afea3 req-94acaf00-be8e-477f-9427-4f1aaa6140b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7bf45f-26da-4ef8-a83e-50807aad4384", "name": "network-vif-unplugged", "status": "completed", "tag": "e74a11b2-3b88-4b9e-bef5-5c0a97c7602a"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5c1e789b-9d3f-4fc0-b3aa-7182052afea3 req-94acaf00-be8e-477f-9427-4f1aaa6140b2 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5c1e789b-9d3f-4fc0-b3aa-7182052afea3 req-94acaf00-be8e-477f-9427-4f1aaa6140b2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:53 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-5c1e789b-9d3f-4fc0-b3aa-7182052afea3 req-94acaf00-be8e-477f-9427-4f1aaa6140b2 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-5c1e789b-9d3f-4fc0-b3aa-7182052afea3 req-94acaf00-be8e-477f-9427-4f1aaa6140b2 service nova] Creating event network-vif-unplugged:e74a11b2-3b88-4b9e-bef5-5c0a97c7602a for instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 on user Nov 27 02:34:53 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-5c1e789b-9d3f-4fc0-b3aa-7182052afea3 req-94acaf00-be8e-477f-9427-4f1aaa6140b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093035 Nov 27 02:34:53 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 439/1297] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:34:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:34:55 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-680d25a1-0674-489c-b925-daeb838e8c41 req-38a8ccef-6340-4ffb-a344-5be3cff791d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7bf45f-26da-4ef8-a83e-50807aad4384", "name": "network-vif-plugged", "status": "completed", "tag": "e74a11b2-3b88-4b9e-bef5-5c0a97c7602a"}, {"server_uuid": "7b7bf45f-26da-4ef8-a83e-50807aad4384", "name": "network-vif-deleted", "tag": "e74a11b2-3b88-4b9e-bef5-5c0a97c7602a"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:34:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-680d25a1-0674-489c-b925-daeb838e8c41 req-38a8ccef-6340-4ffb-a344-5be3cff791d6 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:34:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-680d25a1-0674-489c-b925-daeb838e8c41 req-38a8ccef-6340-4ffb-a344-5be3cff791d6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:34:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-680d25a1-0674-489c-b925-daeb838e8c41 req-38a8ccef-6340-4ffb-a344-5be3cff791d6 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:34:56 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-680d25a1-0674-489c-b925-daeb838e8c41 req-38a8ccef-6340-4ffb-a344-5be3cff791d6 service nova] Creating event network-vif-plugged:e74a11b2-3b88-4b9e-bef5-5c0a97c7602a for instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 on user Nov 27 02:34:56 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-680d25a1-0674-489c-b925-daeb838e8c41 req-38a8ccef-6340-4ffb-a344-5be3cff791d6 service nova] Creating event network-vif-deleted:e74a11b2-3b88-4b9e-bef5-5c0a97c7602a for instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 on user Nov 27 02:34:56 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-680d25a1-0674-489c-b925-daeb838e8c41 req-38a8ccef-6340-4ffb-a344-5be3cff791d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033320 Nov 27 02:34:56 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 430/1298] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:34:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 7b7bf45f-26da-4ef8-a83e-50807aad4384] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=4 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=8 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:35:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.wsgi [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 could not be found. Nov 27 02:35:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance 7b7bf45f-26da-4ef8-a83e-50807aad4384 could not be found. {{(pid=65193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:35:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-f4a9586e-f0b2-4bd8-8555-846624e14863 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384" status: 404 len: 111 microversion: 2.1 time: 0.036739 Nov 27 02:35:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 430/1299] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:35:43 2023] GET /compute/v2.1/servers/7b7bf45f-26da-4ef8-a83e-50807aad4384 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:35:44 user devstack@n-api.service[65194]: INFO oslo.messaging._drivers.impl_rabbit [-] [d93a33c4-2c4a-4e51-984a-1d3906e48e4f] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49850. Nov 27 02:35:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 could not be found. Nov 27 02:35:44 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:35:44 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-4ffb90be-ced3-48ff-ab94-d04d471db3b6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147" status: 404 len: 111 microversion: 2.1 time: 0.039531 Nov 27 02:35:44 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 440/1300] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:35:44 2023] DELETE /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] [instance: 9e520ec4-aa92-42ca-9ec7-ada6805ca147] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:35:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.wsgi [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] HTTP exception thrown: Instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 could not be found. Nov 27 02:35:44 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Returning 404 to user: Instance 9e520ec4-aa92-42ca-9ec7-ada6805ca147 could not be found. {{(pid=65192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:35:44 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-e86fe33e-cbfa-4d28-964b-ad0fb39f1ca6 tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147" status: 404 len: 111 microversion: 2.1 time: 0.041830 Nov 27 02:35:44 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 431/1301] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:35:44 2023] GET /compute/v2.1/servers/9e520ec4-aa92-42ca-9ec7-ada6805ca147 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:35:47 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-c498438d-f881-4f49-8a16-4a456c0d07fe tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] Calling method '.version_select at 0x7f364b07ba30>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:35:47 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-c498438d-f881-4f49-8a16-4a456c0d07fe tempest-TestVolumeBootPattern-1092048365 tempest-TestVolumeBootPattern-1092048365-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1203669430" status: 202 len: 0 microversion: 2.1 time: 0.041273 Nov 27 02:35:47 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 431/1302] 10.0.0.210 () {62 vars in 1340 bytes} [Mon Nov 27 02:35:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1203669430 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:36:29 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:36:29 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:36:30 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-0dab729f-f97b-45fd-a6cf-693664c78eb6 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Action: 'create', calling method: .version_select at 0x7f364afb28c0>, body: {"keypair": {"name": "tempest-keypair-135304585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnROnkv2PuZAsh6K1y9aNGaUTOECTcaskd9IIi8C1Bgm76F6EIuszdxA8w4AFeYVGeQBsywZZyEcUJ3hvfN7Y/6im3wD1bi5hfFhTk4U0bNCfGLMsvFpctdnYrI2I5oqg=="}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:36:30 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-0dab729f-f97b-45fd-a6cf-693664c78eb6 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Getting quotas for project a10e523d4e184633ad1fcf04f57e50a6. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:36:30 user devstack@n-api.service[65194]: DEBUG nova.quota [None req-0dab729f-f97b-45fd-a6cf-693664c78eb6 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Getting quotas for user cd6644d17a034b5cab20476c5f7608ac and project a10e523d4e184633ad1fcf04f57e50a6. Resources: {'key_pairs'} {{(pid=65194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:36:30 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-0dab729f-f97b-45fd-a6cf-693664c78eb6 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.308031 Nov 27 02:36:30 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 441/1303] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Nov 27 02:36:29 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:36:34 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-150260134", "imageRef": "90ee5c23-b10e-4785-b18a-9db7939564b3", "flavorRef": "1", "key_name": "tempest-keypair-135304585", "security_groups": [{"name": "tempest-secgroup-smoke-822884371"}, {"name": "tempest-securitygroup--1724123924"}], "networks": [{"uuid": "5955a2ea-1177-4342-87fb-6ae910a995f2"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:36:34 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:36:34 user devstack@n-api.service[65192]: Mon Nov 27 02:36:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 27 02:36:34 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:36:34 user devstack@n-api.service[65192]: Mon Nov 27 02:36:34 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 27 02:36:34 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:36:34 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.network.neutron [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] validate_networks() for [('5955a2ea-1177-4342-87fb-6ae910a995f2', None, None, None, None, None)] {{(pid=65192) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Flavor limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Image limits 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Flavor pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Image pref 0:0:0 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.virt.hardware [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65192) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Getting quotas for project a10e523d4e184633ad1fcf04f57e50a6. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.quota [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Getting quotas for user cd6644d17a034b5cab20476c5f7608ac and project a10e523d4e184633ad1fcf04f57e50a6. Resources: {'cores', 'instances', 'ram'} {{(pid=65192) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Going to run 1 instances... {{(pid=65192) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 27 02:36:35 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='90ee5c23-b10e-4785-b18a-9db7939564b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65192) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 27 02:36:35 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-203bc857-bfa7-4b6f-9cca-69df527087d1 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 450 microversion: 2.1 time: 1.127215 Nov 27 02:36:35 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 432/1304] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Nov 27 02:36:34 2023] POST /compute/v2.1/servers => generated 450 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 27 02:36:35 user devstack@n-api.service[65193]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:36:35 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:36:35 user devstack@n-api.service[65193]: Mon Nov 27 02:36:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030 (ip 10.0.0.210) !!! Nov 27 02:36:35 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:36:35 user devstack@n-api.service[65193]: Mon Nov 27 02:36:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030 (ip 10.0.0.210) !!! Nov 27 02:36:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:36:35 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:36:35 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-186c9bfa-205c-44b5-9251-e391dfc775c3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:36:35 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-186c9bfa-205c-44b5-9251-e391dfc775c3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:36:35 user devstack@n-api.service[65193]: DEBUG nova.policy [None req-186c9bfa-205c-44b5-9251-e391dfc775c3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6644d17a034b5cab20476c5f7608ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e523d4e184633ad1fcf04f57e50a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65193) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:36:35 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-186c9bfa-205c-44b5-9251-e391dfc775c3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030" status: 200 len: 1234 microversion: 2.1 time: 0.104690 Nov 27 02:36:35 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 432/1305] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:36:35 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030 => generated 1234 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:36:39 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [req-13f654b3-e1a8-4ceb-894d-61a1e64f6c70 req-edae37bc-bf76-4795-a3db-7c85ec149846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a37d691-526b-4cb4-81fd-9b0f2c186030", "tag": "9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f"}]} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:36:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-13f654b3-e1a8-4ceb-894d-61a1e64f6c70 req-edae37bc-bf76-4795-a3db-7c85ec149846 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:36:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-13f654b3-e1a8-4ceb-894d-61a1e64f6c70 req-edae37bc-bf76-4795-a3db-7c85ec149846 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:36:39 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [req-13f654b3-e1a8-4ceb-894d-61a1e64f6c70 req-edae37bc-bf76-4795-a3db-7c85ec149846 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:36:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.compute.server_external_events [req-13f654b3-e1a8-4ceb-894d-61a1e64f6c70 req-edae37bc-bf76-4795-a3db-7c85ec149846 service nova] Creating event network-changed:9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f for instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 on user Nov 27 02:36:39 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [req-13f654b3-e1a8-4ceb-894d-61a1e64f6c70 req-edae37bc-bf76-4795-a3db-7c85ec149846 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037135 Nov 27 02:36:39 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 442/1306] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:36:41 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-b0866747-ade1-4a88-8007-8382a759a02b req-4d36bbf4-c157-473e-9b21-9052934f2ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a37d691-526b-4cb4-81fd-9b0f2c186030", "name": "network-vif-plugged", "status": "completed", "tag": "9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:36:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b0866747-ade1-4a88-8007-8382a759a02b req-4d36bbf4-c157-473e-9b21-9052934f2ab1 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:36:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b0866747-ade1-4a88-8007-8382a759a02b req-4d36bbf4-c157-473e-9b21-9052934f2ab1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:36:41 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-b0866747-ade1-4a88-8007-8382a759a02b req-4d36bbf4-c157-473e-9b21-9052934f2ab1 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:36:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-b0866747-ade1-4a88-8007-8382a759a02b req-4d36bbf4-c157-473e-9b21-9052934f2ab1 service nova] Creating event network-vif-plugged:9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f for instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 on user Nov 27 02:36:41 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-b0866747-ade1-4a88-8007-8382a759a02b req-4d36bbf4-c157-473e-9b21-9052934f2ab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044185 Nov 27 02:36:41 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 433/1307] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:36:43 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-916d8f78-61b8-423c-836e-75c8b9f46677 req-1ead7637-33ef-443d-ba0a-41d9ad269dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a37d691-526b-4cb4-81fd-9b0f2c186030", "name": "network-vif-plugged", "status": "completed", "tag": "9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:36:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-916d8f78-61b8-423c-836e-75c8b9f46677 req-1ead7637-33ef-443d-ba0a-41d9ad269dea service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:36:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-916d8f78-61b8-423c-836e-75c8b9f46677 req-1ead7637-33ef-443d-ba0a-41d9ad269dea service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:36:43 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-916d8f78-61b8-423c-836e-75c8b9f46677 req-1ead7637-33ef-443d-ba0a-41d9ad269dea service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:36:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-916d8f78-61b8-423c-836e-75c8b9f46677 req-1ead7637-33ef-443d-ba0a-41d9ad269dea service nova] Creating event network-vif-plugged:9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f for instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 on user Nov 27 02:36:43 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-916d8f78-61b8-423c-836e-75c8b9f46677 req-1ead7637-33ef-443d-ba0a-41d9ad269dea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038173 Nov 27 02:36:43 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 433/1308] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell0:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:37:26 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6644d17a034b5cab20476c5f7608ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e523d4e184633ad1fcf04f57e50a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:37:26 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-adc1e7de-ade0-4485-b3d2-27ff84370d7d tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030" status: 200 len: 1591 microversion: 2.1 time: 0.235891 Nov 27 02:37:26 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 443/1309] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:37:26 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030 => generated 1591 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell0:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:26 user devstack@n-api.service[65192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:26 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:26 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-607615bd-9bb2-46a7-8901-cb63ddadd07b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.307742 Nov 27 02:38:26 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 434/1310] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Nov 27 02:38:26 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-interface => generated 282 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:38:27 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:38:27 user devstack@n-api.service[65193]: Mon Nov 27 02:38:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 27 02:38:27 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell0:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:27 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:27 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:27 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] [d48adc69-511f-462c-90d1-f76ae1ad7510] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 40900. Nov 27 02:38:27 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-390d1c05-c429-48f7-9dc0-8fafed68bf52 req-4d0bcfa3-c4ff-4501-b60f-046a6ea61f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a37d691-526b-4cb4-81fd-9b0f2c186030", "tag": "9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:38:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-390d1c05-c429-48f7-9dc0-8fafed68bf52 req-4d0bcfa3-c4ff-4501-b60f-046a6ea61f08 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-390d1c05-c429-48f7-9dc0-8fafed68bf52 req-4d0bcfa3-c4ff-4501-b60f-046a6ea61f08 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:27 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-390d1c05-c429-48f7-9dc0-8fafed68bf52 req-4d0bcfa3-c4ff-4501-b60f-046a6ea61f08 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:27 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-390d1c05-c429-48f7-9dc0-8fafed68bf52 req-4d0bcfa3-c4ff-4501-b60f-046a6ea61f08 service nova] Creating event network-changed:9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f for instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 on user Nov 27 02:38:27 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-390d1c05-c429-48f7-9dc0-8fafed68bf52 req-4d0bcfa3-c4ff-4501-b60f-046a6ea61f08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052243 Nov 27 02:38:27 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 434/1311] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:38:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:27 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6644d17a034b5cab20476c5f7608ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e523d4e184633ad1fcf04f57e50a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:38:27 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-75df4b13-828b-4eff-a1ea-12a8cd0ebec3 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030" status: 200 len: 1591 microversion: 2.1 time: 0.333703 Nov 27 02:38:27 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 444/1312] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:38:27 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030 => generated 1591 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:38:30 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "603795d1-31a5-496c-9302-ba046a9ddb07"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:38:30 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:38:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:30 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:30 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] [94902437-d046-41f5-bcd0-1e370883f75a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 39154. Nov 27 02:38:31 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-6b5cd068-fc6c-48e2-b859-66348e1559b2 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307171 Nov 27 02:38:31 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 435/1313] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:38:30 2023] POST /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:52 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lazy-loading 'services' on Instance uuid 5a37d691-526b-4cb4-81fd-9b0f2c186030 {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:38:52 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-d520804a-c510-4464-99cf-48bfd96bdd37 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments/603795d1-31a5-496c-9302-ba046a9ddb07" status: 202 len: 0 microversion: 2.1 time: 0.237340 Nov 27 02:38:52 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 435/1314] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:38:52 2023] DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments/603795d1-31a5-496c-9302-ba046a9ddb07 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:38:52 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:38:52 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-232c7d35-eed0-4618-9331-aa2225206c77 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047617 Nov 27 02:38:52 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 445/1315] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:38:52 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:39:42 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:39:42 user devstack@n-api.service[65192]: Mon Nov 27 02:39:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments (ip 10.0.0.210) !!! Nov 27 02:39:42 user devstack@n-api.service[65192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:39:42 user devstack@n-api.service[65192]: Mon Nov 27 02:39:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments (ip 10.0.0.210) !!! Nov 27 02:39:42 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=4 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:39:42 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:39:42 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:39:42 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:39:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:39:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:39:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:39:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:39:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:39:43 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:39:43 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-844a0e62-adf3-425b-904f-1400a3c309dd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066550 Nov 27 02:39:43 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 436/1316] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:39:42 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2084c397-d038-45e4-8df4-4f3c68499efd"}} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:39:45 user devstack@n-api.service[65193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 27 02:39:45 user devstack@n-api.service[65193]: Mon Nov 27 02:39:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments (ip 10.0.0.210) !!! Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:39:45 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:39:46 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-bb9e5ed9-f184-4309-b284-800018bdb1fb tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.438472 Nov 27 02:39:46 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 436/1317] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:39:45 2023] POST /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:39:56 user devstack@n-api.service[65194]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d93a33c4-2c4a-4e51-984a-1d3906e48e4f] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:39:56 user devstack@n-api.service[65194]: DEBUG nova.objects.instance [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lazy-loading 'services' on Instance uuid 5a37d691-526b-4cb4-81fd-9b0f2c186030 {{(pid=65194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:39:56 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-a4a308d7-7951-425a-96c3-481b2ba2d9c8 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments/2084c397-d038-45e4-8df4-4f3c68499efd" status: 202 len: 0 microversion: 2.1 time: 0.169998 Nov 27 02:39:56 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 446/1318] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:39:56 2023] DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments/2084c397-d038-45e4-8df4-4f3c68499efd => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:39:56 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:39:56 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-df020ef9-06ac-4562-83e1-4fcaebafef95 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053145 Nov 27 02:39:56 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 437/1319] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:39:56 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:40:46 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:40:46 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-4da2ec10-f228-4c5a-84e0-57865016fdc4 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058379 Nov 27 02:40:46 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 437/1320] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:40:46 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fe7cd6c-d03c-4246-adc4-92ca39e405b7"}} {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:40:49 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:40:49 user devstack@n-api.service[65194]: INFO oslo.messaging._drivers.impl_rabbit [-] [d93a33c4-2c4a-4e51-984a-1d3906e48e4f] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 38492. Nov 27 02:40:49 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3339a7fb-46b0-4909-a9bc-f62542f53bfc tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331805 Nov 27 02:40:49 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 447/1321] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:40:49 2023] POST /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:40:59 user devstack@n-api.service[65192]: DEBUG nova.objects.instance [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lazy-loading 'services' on Instance uuid 5a37d691-526b-4cb4-81fd-9b0f2c186030 {{(pid=65192) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:41:00 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-0afe8384-15ad-4634-9636-af5ab7dc985e tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments/4fe7cd6c-d03c-4246-adc4-92ca39e405b7" status: 202 len: 0 microversion: 2.1 time: 0.254497 Nov 27 02:41:00 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 438/1322] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:40:59 2023] DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments/4fe7cd6c-d03c-4246-adc4-92ca39e405b7 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:41:00 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:41:00 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-49821dc8-51ff-4218-a218-b3413a3195bd tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055735 Nov 27 02:41:00 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 438/1323] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:41:00 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:41:50 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:41:50 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-3cc7ae72-1b08-40ed-9289-3235420215b5 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.170095 Nov 27 02:41:50 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 448/1324] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:41:50 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27c5359a-8c67-4c33-a1b2-081032a6aa5d"}} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:41:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:41:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-8b504854-f32d-404e-ae42-c8df10a307ca tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358019 Nov 27 02:41:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 439/1325] 10.0.0.210 () {64 vars in 1400 bytes} [Mon Nov 27 02:41:53 2023] POST /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=6 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:42:03 user devstack@n-api.service[65193]: DEBUG nova.objects.instance [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lazy-loading 'services' on Instance uuid 5a37d691-526b-4cb4-81fd-9b0f2c186030 {{(pid=65193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 27 02:42:03 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-739cbfae-ffc4-4861-83dd-3fcc43ca4235 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments/27c5359a-8c67-4c33-a1b2-081032a6aa5d" status: 202 len: 0 microversion: 2.1 time: 0.201722 Nov 27 02:42:03 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 439/1326] 10.0.0.210 () {62 vars in 1493 bytes} [Mon Nov 27 02:42:03 2023] DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments/27c5359a-8c67-4c33-a1b2-081032a6aa5d => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:42:03 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:42:03 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-6ead4259-e383-459d-bc03-f6135bfb4276 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Nov 27 02:42:03 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 449/1327] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:42:03 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG nova.compute.api [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65192) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:42:53 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:42:53 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [None req-2c809978-775d-4478-8f28-bdf17fee95ff tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054729 Nov 27 02:42:53 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 440/1328] 10.0.0.210 () {62 vars in 1379 bytes} [Mon Nov 27 02:42:53 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=2 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65193) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:43:16 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:43:17 user devstack@n-api.service[65193]: DEBUG nova.compute.api [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Going to try to terminate instance {{(pid=65193) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 27 02:43:17 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-41936600-05c8-4e03-a486-b94de5afef3b tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030" status: 204 len: 0 microversion: 2.1 time: 0.125824 Nov 27 02:43:17 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 440/1329] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Nov 27 02:43:16 2023] DELETE /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=2 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:43:17 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_api:SELECT=2 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:43:17 user devstack@n-api.service[65192]: DEBUG dbcounter [-] [65192] Writing DB stats nova_cell1:SELECT=6 {{(pid=65192) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:43:17 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-5b85e2cb-1079-4246-a5fb-0585215e507c req-d252995c-5b23-414f-a7c2-756134fe7d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a37d691-526b-4cb4-81fd-9b0f2c186030", "name": "network-vif-unplugged", "status": "completed", "tag": "9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:43:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5b85e2cb-1079-4246-a5fb-0585215e507c req-d252995c-5b23-414f-a7c2-756134fe7d37 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:43:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5b85e2cb-1079-4246-a5fb-0585215e507c req-d252995c-5b23-414f-a7c2-756134fe7d37 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:43:17 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-5b85e2cb-1079-4246-a5fb-0585215e507c req-d252995c-5b23-414f-a7c2-756134fe7d37 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:43:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-5b85e2cb-1079-4246-a5fb-0585215e507c req-d252995c-5b23-414f-a7c2-756134fe7d37 service nova] Creating event network-vif-unplugged:9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f for instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 on user Nov 27 02:43:17 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-5b85e2cb-1079-4246-a5fb-0585215e507c req-d252995c-5b23-414f-a7c2-756134fe7d37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095543 Nov 27 02:43:17 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 441/1330] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:43:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:43:17 user devstack@n-api.service[65194]: DEBUG nova.policy [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd6644d17a034b5cab20476c5f7608ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10e523d4e184633ad1fcf04f57e50a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65194) authorize /opt/stack/nova/nova/policy.py:203}} Nov 27 02:43:17 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-9b023701-4ab3-454a-977c-aa5aad4823b0 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030" status: 200 len: 1716 microversion: 2.1 time: 0.403271 Nov 27 02:43:17 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 450/1331] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:43:17 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030 => generated 1716 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 27 02:43:18 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [req-2f0d6551-3b43-4df0-b3f2-5f51969a7d52 req-9eb69a9e-784d-4b44-a699-c46bd8fa0296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a37d691-526b-4cb4-81fd-9b0f2c186030", "name": "network-vif-deleted", "tag": "9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f"}]} {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:43:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2f0d6551-3b43-4df0-b3f2-5f51969a7d52 req-9eb69a9e-784d-4b44-a699-c46bd8fa0296 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:43:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2f0d6551-3b43-4df0-b3f2-5f51969a7d52 req-9eb69a9e-784d-4b44-a699-c46bd8fa0296 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:43:18 user devstack@n-api.service[65193]: DEBUG oslo_concurrency.lockutils [req-2f0d6551-3b43-4df0-b3f2-5f51969a7d52 req-9eb69a9e-784d-4b44-a699-c46bd8fa0296 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65193) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:43:18 user devstack@n-api.service[65193]: INFO nova.api.openstack.compute.server_external_events [req-2f0d6551-3b43-4df0-b3f2-5f51969a7d52 req-9eb69a9e-784d-4b44-a699-c46bd8fa0296 service nova] Creating event network-vif-deleted:9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f for instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 on user Nov 27 02:43:18 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [req-2f0d6551-3b43-4df0-b3f2-5f51969a7d52 req-9eb69a9e-784d-4b44-a699-c46bd8fa0296 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080358 Nov 27 02:43:18 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 441/1332] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:43:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:43:19 user devstack@n-api.service[65192]: DEBUG nova.api.openstack.wsgi [req-e63ba7f5-c46d-4b4c-9b63-e7e211dfb04a req-201029e6-b172-4dfa-a4a4-ed38c9fe3a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a37d691-526b-4cb4-81fd-9b0f2c186030", "name": "network-vif-plugged", "status": "completed", "tag": "9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f"}]} {{(pid=65192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 27 02:43:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e63ba7f5-c46d-4b4c-9b63-e7e211dfb04a req-201029e6-b172-4dfa-a4a4-ed38c9fe3a45 service nova] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:43:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e63ba7f5-c46d-4b4c-9b63-e7e211dfb04a req-201029e6-b172-4dfa-a4a4-ed38c9fe3a45 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:43:19 user devstack@n-api.service[65192]: DEBUG oslo_concurrency.lockutils [req-e63ba7f5-c46d-4b4c-9b63-e7e211dfb04a req-201029e6-b172-4dfa-a4a4-ed38c9fe3a45 service nova] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65192) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:43:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.compute.server_external_events [req-e63ba7f5-c46d-4b4c-9b63-e7e211dfb04a req-201029e6-b172-4dfa-a4a4-ed38c9fe3a45 service nova] Creating event network-vif-plugged:9a3d8f8c-3250-4ca2-84f6-176f7a0b5d6f for instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 on user Nov 27 02:43:19 user devstack@n-api.service[65192]: INFO nova.api.openstack.requestlog [req-e63ba7f5-c46d-4b4c-9b63-e7e211dfb04a req-201029e6-b172-4dfa-a4a4-ed38c9fe3a45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031398 Nov 27 02:43:19 user devstack@n-api.service[65192]: [pid: 65192|app: 0|req: 442/1333] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Nov 27 02:43:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '>' {{(pid=65194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG nova.compute.api [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] [instance: 5a37d691-526b-4cb4-81fd-9b0f2c186030] Fetching instance by UUID {{(pid=65194) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_api:SELECT=4 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG dbcounter [-] [65194] Writing DB stats nova_cell1:SELECT=6 {{(pid=65194) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Acquiring lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG oslo_concurrency.lockutils [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Lock "2205dd81-f9af-4c80-b3d5-3db97aa991c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65194) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 27 02:44:07 user devstack@n-api.service[65194]: INFO nova.api.openstack.wsgi [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] HTTP exception thrown: Instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 could not be found. Nov 27 02:44:07 user devstack@n-api.service[65194]: DEBUG nova.api.openstack.wsgi [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Returning 404 to user: Instance 5a37d691-526b-4cb4-81fd-9b0f2c186030 could not be found. {{(pid=65194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 27 02:44:07 user devstack@n-api.service[65194]: INFO nova.api.openstack.requestlog [None req-f96d1ba9-7e30-4d87-87c6-42a2e3d1e960 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030" status: 404 len: 111 microversion: 2.1 time: 0.030412 Nov 27 02:44:07 user devstack@n-api.service[65194]: [pid: 65194|app: 0|req: 451/1334] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Nov 27 02:44:07 2023] GET /compute/v2.1/servers/5a37d691-526b-4cb4-81fd-9b0f2c186030 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 27 02:44:07 user devstack@n-api.service[65193]: DEBUG nova.api.openstack.wsgi [None req-a12cd5c4-d158-4f21-8fc1-0b1ae3e64525 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] Calling method '.version_select at 0x7f364b07be20>' {{(pid=65193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 27 02:44:07 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:44:07 user devstack@n-api.service[65193]: DEBUG dbcounter [-] [65193] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65193) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 27 02:44:07 user devstack@n-api.service[65193]: INFO nova.api.openstack.requestlog [None req-a12cd5c4-d158-4f21-8fc1-0b1ae3e64525 tempest-SnapshotDataIntegrityTests-1202207742 tempest-SnapshotDataIntegrityTests-1202207742-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135304585" status: 202 len: 0 microversion: 2.1 time: 0.043391 Nov 27 02:44:07 user devstack@n-api.service[65193]: [pid: 65193|app: 0|req: 442/1335] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Nov 27 02:44:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135304585 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)